Nov 03 18:16:02 devstack cinder-volume[75782]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 18:16:02 devstack cinder-volume[75782]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 18:16:02 devstack cinder-volume[75782]: we strongly recommend against using it for new projects. Nov 03 18:16:02 devstack cinder-volume[75782]: If you are already using Eventlet, we recommend migrating to a different Nov 03 18:16:02 devstack cinder-volume[75782]: framework. For more detail see Nov 03 18:16:02 devstack cinder-volume[75782]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 18:16:02 devstack cinder-volume[75782]: import eventlet # noqa Nov 03 18:16:05 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:16:05 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:16:05 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:16:06 devstack cinder-volume[75782]: INFO dbcounter [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Registered counter for database cinder Nov 03 18:16:06 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:16:06 devstack cinder-volume[75782]: DEBUG dbcounter [-] [75782] Writer thread running {{(pid=75782) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 18:16:06 devstack cinder-volume[75782]: INFO cinder.rpc [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 18:16:06 devstack cinder-volume[75782]: INFO cinder.rpc [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 18:16:06 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:16:06 devstack cinder-volume[75782]: INFO cinder.volume.manager [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Determined volume DB was empty at startup. Nov 03 18:16:06 devstack cinder-volume[75782]: DEBUG cinder.volume.manager [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75782) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 18:16:06 devstack cinder-volume[75782]: INFO cinder.volume.manager [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 18:16:06 devstack cinder-volume[75782]: WARNING stevedore.named [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 18:16:06 devstack cinder-volume[75782]: WARNING castellan.key_manager [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:16:06 devstack cinder-volume[75782]: WARNING cinder.keymgr.conf_key_mgr [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:16:06 devstack cinder-volume[75782]: DEBUG cinder.volume.drivers.lvm [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75782) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 03 18:16:06 devstack cinder-volume[75782]: DEBUG oslo_concurrency.processutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75782) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_concurrency.processutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] CMD "cinder-rtstool verify" returned: 0 in 0.405s {{(pid=75782) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:16:07 devstack cinder-volume[75782]: INFO cinder.rpc [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 03 18:16:07 devstack cinder-volume[75782]: INFO cinder.rpc [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 03 18:16:07 devstack cinder-volume[75782]: WARNING stevedore.named [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 18:16:07 devstack cinder-volume[75782]: WARNING castellan.key_manager [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:16:07 devstack cinder-volume[75782]: INFO cinder.volume.manager [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:16:07 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Starting 1 workers Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Started child 75943 {{(pid=75782) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Full set of CONF: {{(pid=75782) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] ******************************************************************************** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Configuration options gathered from: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] ================================================================================ {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] allow_availability_zone_fallback = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] allow_compression_on_image_upload = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] allowed_direct_url_schemes = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] api_rate_limit = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] auth_strategy = keystone {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] az_cache_duration = 3600 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_host = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_stats_polling_interval = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backup_api_class = cinder.backup.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backup_name_template = backup-%s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backup_use_same_host = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backup_use_temp_snapshot = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] chap_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] chap_username = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_internal_tenant_project_id = 96e82c306c544dcfa542e75e30f12ec5 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_internal_tenant_user_id = c30daadb77994244a28937203604ee27 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cloned_volume_same_az = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cluster = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] compression_format = gzip {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] compute_api_class = cinder.compute.nova.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] config_dir = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] config_source = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] control_exchange = openstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] debug = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] default_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] default_group_type = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] default_volume_type = lvmdriver-1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] disk_geometry = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] driver_client_cert = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75943]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] driver_client_cert_key = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] driver_data_namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] driver_ssl_cert_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] driver_ssl_cert_verify = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] driver_use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] enable_force_upload = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] enable_new_services = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] enable_unsupported_driver = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] enforce_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] filter_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_api_insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_api_servers = ['http://192.168.122.150/image'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_api_ssl_compression = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_ca_certificates_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_catalog_info = image:glance:publicURL {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_num_retries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance_request_timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] goodness_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] graceful_shutdown_timeout = 5 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] group_api_class = cinder.group.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] host = devstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_compress_on_upload = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_conversion_address_space_limit = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_conversion_cpu_limit = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_conversion_disable = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_introspection_address_space_limit = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_introspection_cpu_limit = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_upload_use_cinder_backend = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_upload_use_internal_tenant = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_volume_cache_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_volume_cache_max_count = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] image_volume_cache_max_size_gb = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] init_host_max_objects_retrieval = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] instance_format = [instance: %(uuid)s] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] iscsi_target_flags = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] iscsi_write_cache = on {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] iser_helper = tgtadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] iser_ip_address = 192.168.122.150 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] iser_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_color = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_config_append = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_dir = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_options = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_rotate_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_rotate_interval_type = days {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] log_rotation_type = none {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] max_age = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] max_logfile_count = 30 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] max_logfile_size_mb = 200 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] max_over_subscription_ratio = 20.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] message_reap_interval = 86400 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] message_ttl = 2592000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] migration_create_volume_timeout_secs = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] monkey_patch = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] monkey_patch_modules = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] my_ip = 192.168.122.150 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] no_snapshot_gb_quota = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] num_iser_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] num_shell_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] num_volume_device_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] nvmeof_conn_info_version = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] nvmet_ns_id = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] nvmet_port_id = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_max_limit = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_volume_ext_list = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_volume_listen_port = 8776 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_volume_use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] osapi_volume_workers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] per_volume_size_limit = -1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] periodic_fuzzy_delay = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] periodic_interval = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] public_endpoint = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] publish_errors = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_backup_gigabytes = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_backups = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_gigabytes = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_groups = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_snapshots = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] quota_volumes = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] rate_limit_burst = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] rate_limit_except_level = CRITICAL {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] rate_limit_interval = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] reinit_driver_count = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] replication_device = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] report_discard_supported = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] report_interval = 120 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] reservation_clean_interval = 86400 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] reservation_expire = 86400 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] reserved_image_namespaces = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] reserved_percentage = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] rpc_response_timeout = 120 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] run_external_periodic_tasks = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] scst_target_driver = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] scst_target_iqn_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_down_time = 720 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] shell_completion = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] snapshot_name_template = snapshot-%s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] snapshot_same_host = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] state_path = /opt/stack/data/cinder {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] storage_availability_zone = nova {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] storage_protocol = iSCSI {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] syslog_log_facility = LOG_USER {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] target_helper = lioadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] target_ip_address = 192.168.122.150 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] target_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] target_protocol = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] target_secondary_ip_addresses = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] trace_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] transport_url = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] until_refresh = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_chap_auth = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_default_quota_class = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_journal = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_json = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_stderr = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] use_syslog = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] verify_glance_signatures = enabled {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_api_class = cinder.volume.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_backend_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_clear = zero {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_clear_ionice = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_clear_size = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_copy_bps_limit = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_dd_blocksize = 1M {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_name_template = volume-%s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_service_inithost_offload = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volume_usage_audit_period = month {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] zoning_mode = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_concurrency.disable_process_locking = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.auth_type = password {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.auth_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.cache = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.include_service_catalog = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.interface = public {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcache_username = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.region_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.service_type = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.150/identity {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.backend = dogpile.cache.null {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.backend_argument = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.backend_expiration_time = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.config_prefix = cache.oslo {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.debug_cache_backend = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.enable_retry_client = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.enable_socket_keepalive = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.expiration_time = 600 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.hashclient_retry_attempts = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_dead_retry = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_pool_maxsize = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_sasl_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.proxies = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.redis_db = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.redis_server = localhost:6379 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.retry_attempts = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.retry_delay = 0.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.socket_keepalive_count = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.socket_keepalive_idle = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.socket_keepalive_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.socket_timeout = 1.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.tls_allowed_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.tls_cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.tls_certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.tls_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.tls_keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cache.username = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] coordination.backend_url = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.asyncio_connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.asyncio_slave_connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.backend = sqlalchemy {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.connection_debug = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.connection_parameters = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.connection_recycle_time = 3600 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.connection_trace = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.db_inc_retry_interval = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.db_max_retries = 20 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.db_max_retry_interval = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.db_retry_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.max_overflow = 50 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.max_pool_size = 5 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.max_retries = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.mysql_wsrep_sync_wait = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.pool_timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.retry_interval = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.slave_connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.sqlite_synchronous = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.synchronous_reader = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] database.use_db_reconnect = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_tracing.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.connection_string = messaging:// {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.es_doc_type = notification {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.es_scroll_size = 10000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.es_scroll_time = 2m {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.filter_error_trace = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.hmac_keys = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.sentinel_service_name = mymaster {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.socket_timeout = 0.1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.trace_requests = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler.trace_sqlalchemy = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler_jaeger.process_tags = {} {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler_jaeger.service_name_prefix = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] profiler_otlp.service_name_prefix = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.enforce_new_defaults = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.policy_default_rule = default {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.policy_file = policy.yaml {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.group = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.helper_command = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] privsep_osbrick.user = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.group = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.helper_command = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] cinder_sys_admin.user = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.auth_type = password {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.send_service_user_token = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] service_user.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.auth_type = password {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.region_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] glance.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.backend_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.chap_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.chap_username = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.disk_geometry = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.driver_client_cert = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.driver_client_cert_key = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.driver_data_namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.driver_use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.extra_capabilities = {} {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.filter_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.goodness_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.iscsi_target_flags = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.iscsi_write_cache = on {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.iser_helper = tgtadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.iser_ip_address = 192.168.122.150 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.iser_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.lvm_share_target = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.lvm_type = auto {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.num_shell_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.replication_device = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.report_discard_supported = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.reserved_percentage = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.target_helper = tgtadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.target_ip_address = 192.168.122.150 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.target_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.target_protocol = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.trace_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.unique_fqdn_network = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.use_chap_auth = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_backend_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_clear = zero {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_clear_ionice = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_clear_size = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_reports.file_event_handler = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_reports.log_dir = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.backend_host = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.chap_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.chap_username = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.disk_geometry = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.driver_client_cert = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.extra_capabilities = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.filter_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.goodness_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.iser_helper = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.iser_ip_address = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.iser_port = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack sudo[75947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.lvm_share_target = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.lvm_type = auto {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.num_shell_tries = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.replication_device = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.report_discard_supported = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.reserved_percentage = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.scst_target_driver = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.storage_protocol = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.target_helper = lioadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.target_ip_address = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.target_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.trace_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.use_chap_auth = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_clear = zero {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_clear_size = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] lvmdriver-1.volumes_dir = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_notifications.driver = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_notifications.retry = -1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] key_manager.fixed_key = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.barbican_api_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.barbican_endpoint = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.barbican_endpoint_type = public {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.barbican_region_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.number_of_retries = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.retry_delay = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.send_service_user_token = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.verify_ssl = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican.verify_ssl_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.auth_type = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] barbican_service_user.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.approle_role_id = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.approle_secret_id = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.auth_method = approle {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.auth_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.kv_mountpoint = secret {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.kv_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.kv_version = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.root_token_id = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.ssl_ca_crt_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.timeout = 60.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.token_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.token_role = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:16:07 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] ******************************************************************************** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 18:16:07 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:07 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:07 devstack sudo[75951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:07 devstack sudo[75951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:08 devstack sudo[75951]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.322s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:16:08 devstack cinder-volume[75943]: INFO cinder.brick.local_dev.lvm [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:08 devstack sudo[75978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:16:08 devstack sudo[75978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:08 devstack sudo[75978]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG cinder.brick.local_dev.lvm [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75943) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 03 18:16:08 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:08 devstack sudo[76113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:08 devstack sudo[76113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:09 devstack sudo[76113]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.564s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:09 devstack sudo[76291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:09 devstack sudo[76291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:09 devstack sudo[76291]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:09 devstack sudo[76389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 03 18:16:09 devstack sudo[76389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:09 devstack sudo[76389]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:09 devstack sudo[76475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:16:09 devstack sudo[76475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:09 devstack sudo[76475]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:09 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:10 devstack sudo[76566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:16:10 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:10 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:10 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:10 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:10 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:10 devstack sudo[76653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:10 devstack sudo[76653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:10 devstack sudo[76653]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:10 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:10 devstack sudo[76657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:10 devstack sudo[76657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:11 devstack sudo[76657]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:11 devstack cinder-volume[75943]: INFO cinder.volume.drivers.lvm [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:11 devstack sudo[76747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:11 devstack sudo[76747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:11 devstack sudo[76747]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Updating volume stats {{(pid=75943) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:11 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:16:11 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:11 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:11 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:11 devstack sudo[76759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:11 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:12 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:12 devstack sudo[76762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:12 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:12 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:12 devstack sudo[76766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:12 devstack sudo[76766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:12 devstack sudo[76766]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:12 devstack cinder-volume[75943]: INFO cinder.volume.driver [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Driver hasn't implemented _init_vendor_properties() Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG cinder.volume.driver [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75943) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_db.sqlalchemy.engines [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writer thread running {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG cinder.db.api [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Building query based on filter {{(pid=75943) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG cinder.image.image_utils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75943) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 18:16:12 devstack cinder-volume[75943]: INFO cinder.keymgr.migration [None req-3bc7a895-7ad6-4770-9e93-b378dace35b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Updating volume stats {{(pid=75943) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:12 devstack sudo[76770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:16:12 devstack sudo[76770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:12 devstack sudo[76770]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:12 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:13 devstack sudo[76773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:13 devstack sudo[76773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:13 devstack sudo[76773]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:13 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:13 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:13 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:13 devstack sudo[76781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:13 devstack sudo[76781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:13 devstack sudo[76781]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG cinder.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Notifying Schedulers of capabilities ... {{(pid=75943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:16:13 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Driver initialization completed successfully. Nov 03 18:16:13 devstack cinder-volume[75943]: INFO cinder.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Initiating service 2 cleanup Nov 03 18:16:13 devstack cinder-volume[75943]: INFO cinder.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Service 2 cleanup completed. Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG cinder.service [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Creating RPC server for service cinder-volume {{(pid=75943) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 18:16:13 devstack cinder-volume[75943]: DEBUG cinder.service [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75943) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 18:16:14 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Updating volume stats {{(pid=75943) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:14 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:16:14 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:14 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:14 devstack sudo[76788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:14 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:14 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:14 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:16:14 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:14 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:14 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:16:14 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:16:14 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:16:15 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Nov 03 18:16:15 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:16:15 devstack cinder-volume[75943]: INFO cinder.volume.manager [None req-68c0663d-da4d-472d-ac30-c5fc8711accf None None] Driver post RPC initialization completed successfully. Nov 03 18:16:17 devstack cinder-volume[75782]: DEBUG dbcounter [-] [75782] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75782) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:16:25 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:16:25 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:16:51 devstack cinder-volume[75943]: DEBUG oslo_service.periodic_task [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running periodic task VolumeManager._thread_info {{(pid=75943) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:16:51 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] thread count: 6 {{(pid=75943) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:16:51 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] thread info: [<_MainThread(MainThread, started 131127448658048)>, , , , , ] {{(pid=75943) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_service.periodic_task [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75943) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Updating volume stats {{(pid=75943) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:17:51 devstack sudo[81919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:17:51 devstack sudo[81919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:17:51 devstack sudo[81919]: pam_unix(sudo:session): session closed for user root Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:17:51 devstack sudo[81922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:17:51 devstack sudo[81922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:17:51 devstack sudo[81922]: pam_unix(sudo:session): session closed for user root Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:17:51 devstack sudo[81925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:17:51 devstack sudo[81925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:17:51 devstack sudo[81925]: pam_unix(sudo:session): session closed for user root Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:17:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:17:51 devstack sudo[81928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:17:51 devstack sudo[81928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:17:52 devstack sudo[81928]: pam_unix(sudo:session): session closed for user root Nov 03 18:17:52 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:17:52 devstack cinder-volume[75943]: DEBUG cinder.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Notifying Schedulers of capabilities ... {{(pid=75943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:17:52 devstack cinder-volume[75943]: DEBUG oslo_service.periodic_task [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running periodic task VolumeManager._thread_info {{(pid=75943) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:17:52 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] thread count: 6 {{(pid=75943) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:17:52 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] thread info: [<_MainThread(MainThread, started 131127448658048)>, , , , , ] {{(pid=75943) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:18:25 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:SELECT=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:18:25 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:UPDATE=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_service.periodic_task [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75943) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Updating volume stats {{(pid=75943) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:18:51 devstack sudo[83557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:18:51 devstack sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:18:51 devstack sudo[83557]: pam_unix(sudo:session): session closed for user root Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:18:51 devstack sudo[83564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:18:51 devstack sudo[83564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:18:51 devstack sudo[83564]: pam_unix(sudo:session): session closed for user root Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:18:51 devstack sudo[83569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:18:51 devstack sudo[83569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:18:51 devstack sudo[83569]: pam_unix(sudo:session): session closed for user root Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:18:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:18:52 devstack sudo[83590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:18:52 devstack sudo[83590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:18:52 devstack sudo[83590]: pam_unix(sudo:session): session closed for user root Nov 03 18:18:52 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:18:52 devstack cinder-volume[75943]: DEBUG cinder.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Notifying Schedulers of capabilities ... {{(pid=75943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_service.periodic_task [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75943) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG cinder.volume.drivers.lvm [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Updating volume stats {{(pid=75943) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:19:51 devstack sudo[85060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 03 18:19:51 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:19:51 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:19:51 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:19:51 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:19:51 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:19:51 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 03 18:19:51 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:19:51 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:19:51 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:19:52 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 03 18:19:52 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:19:52 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Nov 03 18:19:52 devstack cinder-volume[75943]: DEBUG oslo_concurrency.processutils [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:19:52 devstack cinder-volume[75943]: DEBUG cinder.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Notifying Schedulers of capabilities ... {{(pid=75943) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:19:52 devstack cinder-volume[75943]: DEBUG oslo_service.periodic_task [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] Running periodic task VolumeManager._thread_info {{(pid=75943) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:19:52 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] thread count: 6 {{(pid=75943) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:19:52 devstack cinder-volume[75943]: DEBUG cinder.volume.manager [None req-1d9aa4b3-db61-44f2-94c8-34cdc06a1599 None None] thread info: [<_MainThread(MainThread, started 131127448658048)>, , , , , ] {{(pid=75943) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:20:25 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:SELECT=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:20:25 devstack cinder-volume[75943]: DEBUG dbcounter [-] [75943] Writing DB stats cinder:UPDATE=1 {{(pid=75943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:20:36 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Caught SIGTERM, stopping children Nov 03 18:20:36 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Acquiring lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:20:36 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Acquired lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:20:36 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Releasing lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:20:36 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Stop services. {{(pid=75782) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 18:20:36 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Killing children. {{(pid=75782) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 18:20:36 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Waiting on 1 children to exit Nov 03 18:20:38 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Acquiring lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:20:38 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Acquired lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:20:38 devstack cinder-volume[75943]: DEBUG oslo_concurrency.lockutils [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Releasing lock "singleton_lock" {{(pid=75943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:20:39 devstack cinder-volume[75943]: WARNING amqp [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 18:20:39 devstack cinder-volume[75943]: WARNING amqp [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 18:20:39 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-d594026e-fd7b-4df6-9088-fb3065f7dd07 None None] Child 75943 exited with status 0 Nov 03 18:20:39 devstack cinder-volume[86000]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 18:20:39 devstack cinder-volume[86000]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 18:20:39 devstack cinder-volume[86000]: we strongly recommend against using it for new projects. Nov 03 18:20:39 devstack cinder-volume[86000]: If you are already using Eventlet, we recommend migrating to a different Nov 03 18:20:39 devstack cinder-volume[86000]: framework. For more detail see Nov 03 18:20:39 devstack cinder-volume[86000]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 18:20:39 devstack cinder-volume[86000]: import eventlet # noqa Nov 03 18:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:20:41 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:20:42 devstack cinder-volume[86000]: INFO dbcounter [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Registered counter for database cinder Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_db.sqlalchemy.engines [None req-7ada6783-a321-4632-9489-0e533be68766 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG dbcounter [-] [86000] Writer thread running {{(pid=86000) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 18:20:42 devstack cinder-volume[86000]: INFO cinder.rpc [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 18:20:42 devstack cinder-volume[86000]: INFO cinder.rpc [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_db.sqlalchemy.engines [None req-7ada6783-a321-4632-9489-0e533be68766 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Determined volume DB was empty at startup. Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG cinder.volume.manager [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86000) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 18:20:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 03 18:20:42 devstack cinder-volume[86000]: WARNING stevedore.named [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 18:20:42 devstack cinder-volume[86000]: WARNING castellan.key_manager [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:20:42 devstack cinder-volume[86000]: WARNING cinder.keymgr.conf_key_mgr [None req-7ada6783-a321-4632-9489-0e533be68766 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:20:42 devstack cinder-volume[86000]: INFO cinder.volume.manager [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_db.sqlalchemy.engines [None req-7ada6783-a321-4632-9489-0e533be68766 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86000) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:42 devstack cinder-volume[86000]: INFO oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Starting 1 workers Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Started child 86225 {{(pid=86000) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Full set of CONF: {{(pid=86000) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] ******************************************************************************** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Configuration options gathered from: {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] ================================================================================ {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] allow_availability_zone_fallback = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] allow_compression_on_image_upload = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] allowed_direct_url_schemes = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] api_rate_limit = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] auth_strategy = keystone {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_availability_zone = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_host = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:42 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86225]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_stats_polling_interval = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backup_api_class = cinder.backup.api.API {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backup_name_template = backup-%s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backup_use_same_host = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backup_use_temp_snapshot = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] chap_password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] chap_username = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_internal_tenant_project_id = 96e82c306c544dcfa542e75e30f12ec5 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_internal_tenant_user_id = c30daadb77994244a28937203604ee27 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cluster = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] compression_format = gzip {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] compute_api_class = cinder.compute.nova.API {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] config_dir = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] config_source = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] control_exchange = openstack {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] debug = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] default_availability_zone = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] default_group_type = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] default_volume_type = QuobyteHD {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] disk_geometry = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] driver_client_cert = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] driver_client_cert_key = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] driver_data_namespace = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] driver_ssl_cert_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] driver_ssl_cert_verify = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] driver_use_ssl = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] enable_new_services = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] enable_unsupported_driver = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] enabled_backends = ['QuobyteHD'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] enforce_multipath_for_image_xfer = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] filter_function = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_api_insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_api_servers = ['http://192.168.122.150/image'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_api_ssl_compression = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_ca_certificates_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_catalog_info = image:glance:publicURL {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_num_retries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance_request_timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] goodness_function = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] graceful_shutdown_timeout = 5 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] group_api_class = cinder.group.api.API {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] host = devstack {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_compress_on_upload = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_conversion_address_space_limit = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_conversion_cpu_limit = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_conversion_disable = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_introspection_address_space_limit = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_introspection_cpu_limit = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_upload_use_cinder_backend = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_upload_use_internal_tenant = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_volume_cache_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_volume_cache_max_count = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] image_volume_cache_max_size_gb = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] init_host_max_objects_retrieval = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] instance_format = [instance: %(uuid)s] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] iscsi_target_flags = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] iscsi_write_cache = on {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] iser_helper = tgtadm {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] iser_ip_address = 192.168.122.150 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] iser_port = 3260 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_color = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_config_append = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_dir = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_options = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_rotate_interval = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_rotate_interval_type = days {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] log_rotation_type = none {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] max_age = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] max_logfile_count = 30 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] max_logfile_size_mb = 200 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] max_over_subscription_ratio = 20.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] message_reap_interval = 86400 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] message_ttl = 2592000 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86225]: INFO cinder.volume.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.remotefs [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86225) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] migration_create_volume_timeout_secs = 300 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] monkey_patch = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] monkey_patch_modules = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] my_ip = 192.168.122.150 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] no_snapshot_gb_quota = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] num_iser_scan_tries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] num_shell_tries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] num_volume_device_scan_tries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] nvmeof_conn_info_version = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] nvmet_ns_id = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] nvmet_port_id = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_max_limit = 1000 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_volume_ext_list = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_volume_listen_port = 8776 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_volume_use_ssl = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] osapi_volume_workers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] per_volume_size_limit = -1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] periodic_fuzzy_delay = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] periodic_interval = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] public_endpoint = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] publish_errors = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_backup_gigabytes = 1000 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_backups = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_gigabytes = 1000 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_groups = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_snapshots = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] quota_volumes = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] rate_limit_burst = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] rate_limit_except_level = CRITICAL {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] rate_limit_interval = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] reinit_driver_count = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] replication_device = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] report_discard_supported = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] report_interval = 120 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] reservation_clean_interval = 86400 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] reservation_expire = 86400 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] reserved_image_namespaces = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] reserved_percentage = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] rpc_response_timeout = 120 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] run_external_periodic_tasks = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] scst_target_driver = iscsi {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] scst_target_iqn_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_down_time = 720 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] shell_completion = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] snapshot_name_template = snapshot-%s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] split_loggers = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] state_path = /opt/stack/data/cinder {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] storage_availability_zone = nova {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] storage_protocol = iSCSI {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] syslog_log_facility = LOG_USER {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] target_helper = lioadm {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] target_ip_address = 192.168.122.150 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] target_port = 3260 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] target_protocol = iscsi {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] target_secondary_ip_addresses = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] trace_flags = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] transport_url = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] until_refresh = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_chap_auth = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_default_quota_class = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_journal = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_json = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_multipath_for_image_xfer = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_stderr = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] use_syslog = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] verify_glance_signatures = enabled {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_api_class = cinder.volume.api.API {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_backend_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_clear = zero {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_clear_ionice = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_clear_size = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_copy_bps_limit = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_dd_blocksize = 1M {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_name_template = volume-%s {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_service_inithost_offload = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volume_usage_audit_period = month {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] zoning_mode = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_concurrency.disable_process_locking = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.auth_section = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.auth_type = password {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.auth_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.cache = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86225) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 18:20:43 devstack cinder-volume[86225]: WARNING cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 18:20:43 devstack cinder-volume[86225]: WARNING cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.include_service_catalog = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.interface = public {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcache_username = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.region_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.service_type = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.150/identity {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.backend = dogpile.cache.null {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.backend_argument = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.backend_expiration_time = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.config_prefix = cache.oslo {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.debug_cache_backend = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.enable_retry_client = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.enable_socket_keepalive = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.expiration_time = 600 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.hashclient_retry_attempts = 2 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_dead_retry = 300 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_pool_maxsize = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_sasl_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.proxies = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.redis_db = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.redis_server = localhost:6379 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.retry_attempts = 2 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.retry_delay = 0.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.socket_keepalive_count = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.socket_keepalive_idle = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.socket_keepalive_interval = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.socket_timeout = 1.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.tls_allowed_ciphers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.tls_cafile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.tls_certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.tls_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.tls_keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cache.username = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] coordination.backend_url = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.asyncio_connection = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.asyncio_slave_connection = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.backend = sqlalchemy {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.connection = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.connection_debug = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.connection_parameters = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.connection_recycle_time = 3600 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.connection_trace = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.db_inc_retry_interval = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.db_max_retries = 20 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.db_max_retry_interval = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.db_retry_interval = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.max_overflow = 50 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.max_pool_size = 5 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.max_retries = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.mysql_wsrep_sync_wait = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.pool_timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.retry_interval = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.slave_connection = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.sqlite_synchronous = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.synchronous_reader = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] database.use_db_reconnect = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_tracing.insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.connection_string = messaging:// {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.es_doc_type = notification {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.es_scroll_size = 10000 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.es_scroll_time = 2m {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.filter_error_trace = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.hmac_keys = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.sentinel_service_name = mymaster {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.socket_timeout = 0.1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.trace_requests = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler.trace_sqlalchemy = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler_jaeger.process_tags = {} {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler_jaeger.service_name_prefix = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] profiler_otlp.service_name_prefix = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.enforce_new_defaults = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.policy_default_rule = default {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.policy_file = policy.yaml {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.group = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.helper_command = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] privsep_osbrick.user = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.group = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.helper_command = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] cinder_sys_admin.user = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.auth_section = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.auth_type = password {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.cafile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.collect_timing = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.send_service_user_token = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.split_loggers = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.tls_ciphers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] service_user.tls_min_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.auth_section = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.auth_type = password {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.collect_timing = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.region_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.split_loggers = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.tls_ciphers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] glance.tls_min_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.backend_availability_zone = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.chap_password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.chap_username = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.disk_geometry = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.driver_client_cert = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.driver_client_cert_key = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.driver_data_namespace = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.driver_use_ssl = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.extra_capabilities = {} {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.filter_function = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.goodness_function = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.iscsi_target_flags = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.iscsi_write_cache = on {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.iser_helper = tgtadm {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.iser_ip_address = 192.168.122.150 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.iser_port = 3260 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_host = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_login = admin {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_mount_options = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_private_key = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_share_path = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.num_shell_tries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.quobyte_volume_url = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.replication_device = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.report_discard_supported = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.reserved_percentage = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.target_helper = tgtadm {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.target_ip_address = 192.168.122.150 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.target_port = 3260 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.target_protocol = iscsi {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.trace_flags = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.unique_fqdn_network = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.use_chap_auth = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_backend_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_clear = zero {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_clear_ionice = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_clear_size = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_reports.file_event_handler = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_reports.log_dir = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.backend_availability_zone = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.backend_host = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.chap_password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.chap_username = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.chiscsi_conf = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.disk_geometry = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.driver_client_cert = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.driver_data_namespace = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.driver_use_ssl = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.extra_capabilities = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.filter_function = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.goodness_function = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.iser_helper = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.iser_ip_address = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.iser_port = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.iser_target_prefix = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_host = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_login = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_mount_options = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_password = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_private_key = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_share_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_ssh_port = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.num_shell_tries = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.nvmet_port_id = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.replication_device = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.report_discard_supported = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.reserved_percentage = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.scst_target_driver = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.storage_protocol = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.target_helper = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.target_ip_address = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.target_port = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.target_prefix = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.target_protocol = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: INFO cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 ... Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.trace_flags = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.use_chap_auth = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b -c /etc/quobyte/client-cinder.cfg {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_clear = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_clear_size = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] QuobyteHD.volumes_dir = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_notifications.driver = [] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_notifications.retry = -1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] key_manager.fixed_key = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.barbican_api_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.barbican_endpoint = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.barbican_endpoint_type = public {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.barbican_region_name = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.cafile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.collect_timing = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.number_of_retries = 60 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.retry_delay = 1 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.send_service_user_token = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.split_loggers = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.tls_ciphers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.tls_min_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.verify_ssl = True {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican.verify_ssl_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.auth_section = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.auth_type = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.cafile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.certfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.collect_timing = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.insecure = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.keyfile = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.split_loggers = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.timeout = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.tls_ciphers = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] barbican_service_user.tls_min_version = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.approle_role_id = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.approle_secret_id = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.auth_method = approle {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.auth_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.kv_mountpoint = secret {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.kv_path = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.kv_version = 2 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.namespace = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.root_token_id = **** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.ssl_ca_crt_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.timeout = 60.0 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.token_file = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b -c /etc/quobyte/client-cinder.cfg Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.token_role = None {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.use_ssl = False {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:43 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] ******************************************************************************** {{(pid=86000) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 18:20:43 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:43 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.451s {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:43 devstack cinder-volume[86225]: INFO cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 succeeded Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.469s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:43 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:43 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:43 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:43 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.239s {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.volume.driver [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.volume.driver [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86225) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_db.sqlalchemy.engines [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86225) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG dbcounter [-] [86225] Writer thread running {{(pid=86225) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.db.api [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Building query based on filter {{(pid=86225) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.image.image_utils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86225) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.keymgr.migration [None req-ab7227eb-8876-4352-ab38-291e8a902f46 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:44 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:44 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:44 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.227s {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Notifying Schedulers of capabilities ... {{(pid=86225) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.volume.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Driver initialization completed successfully. Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Initiating service 3 cleanup Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Service 3 cleanup completed. Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.service [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Creating RPC server for service cinder-volume {{(pid=86225) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.service [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86225) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.volume.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:44 devstack sudo[86340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:44 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:44 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:44 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.246s {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:44 devstack cinder-volume[86225]: INFO cinder.volume.manager [None req-5461c165-b26b-4b7c-85c4-a40c6bb271f8 None None] Driver post RPC initialization completed successfully. Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86225) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG cinder.volume.drivers.quobyte [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86225) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86225) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:49 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:49 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:49 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG oslo_concurrency.processutils [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.236s {{(pid=86225) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:49 devstack cinder-volume[86225]: DEBUG cinder.manager [None req-668fb290-7265-453c-bb69-ba979c0b31a0 None None] Notifying Schedulers of capabilities ... {{(pid=86225) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:20:50 devstack cinder-volume[86000]: INFO oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Caught SIGTERM, stopping children Nov 03 18:20:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Acquiring lock "singleton_lock" {{(pid=86000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:20:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Acquired lock "singleton_lock" {{(pid=86000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:20:50 devstack cinder-volume[86000]: DEBUG oslo_concurrency.lockutils [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Releasing lock "singleton_lock" {{(pid=86000) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:20:50 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Stop services. {{(pid=86000) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 03 18:20:50 devstack cinder-volume[86000]: DEBUG oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Killing children. {{(pid=86000) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 03 18:20:50 devstack cinder-volume[86000]: INFO oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Waiting on 1 children to exit Nov 03 18:20:52 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Acquiring lock "singleton_lock" {{(pid=86225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:20:52 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Acquired lock "singleton_lock" {{(pid=86225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:20:52 devstack cinder-volume[86225]: DEBUG oslo_concurrency.lockutils [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Releasing lock "singleton_lock" {{(pid=86225) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:20:52 devstack cinder-volume[86225]: WARNING amqp [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 18:20:52 devstack cinder-volume[86225]: WARNING amqp [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 03 18:20:52 devstack cinder-volume[86000]: INFO oslo_service.backend._eventlet.service [None req-7ada6783-a321-4632-9489-0e533be68766 None None] Child 86225 exited with status 0 Nov 03 18:20:53 devstack cinder-volume[86541]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 03 18:20:53 devstack cinder-volume[86541]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 18:20:53 devstack cinder-volume[86541]: we strongly recommend against using it for new projects. Nov 03 18:20:53 devstack cinder-volume[86541]: If you are already using Eventlet, we recommend migrating to a different Nov 03 18:20:53 devstack cinder-volume[86541]: framework. For more detail see Nov 03 18:20:53 devstack cinder-volume[86541]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 18:20:53 devstack cinder-volume[86541]: import eventlet # noqa Nov 03 18:20:56 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 03 18:20:56 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 03 18:20:56 devstack cinder-volume[86541]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 03 18:20:57 devstack cinder-volume[86541]: INFO dbcounter [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Registered counter for database cinder Nov 03 18:20:57 devstack cinder-volume[86541]: DEBUG oslo_db.sqlalchemy.engines [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG dbcounter [-] [86541] Writer thread running {{(pid=86541) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 18:20:58 devstack cinder-volume[86541]: INFO cinder.rpc [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 03 18:20:58 devstack cinder-volume[86541]: INFO cinder.rpc [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_db.sqlalchemy.engines [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:58 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Determined volume DB was empty at startup. Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG cinder.volume.manager [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86541) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 03 18:20:58 devstack cinder-volume[86541]: WARNING stevedore.named [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 03 18:20:58 devstack cinder-volume[86541]: WARNING castellan.key_manager [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:20:58 devstack cinder-volume[86541]: WARNING cinder.keymgr.conf_key_mgr [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 03 18:20:58 devstack cinder-volume[86541]: INFO cinder.volume.manager [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_db.sqlalchemy.engines [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:58 devstack cinder-volume[86541]: INFO oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Starting 1 workers Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Started child 86841 {{(pid=86541) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Full set of CONF: {{(pid=86541) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] ******************************************************************************** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] Configuration options gathered from: {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 03 18:20:58 devstack cinder-volume[86841]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] ================================================================================ {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] allow_availability_zone_fallback = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] allow_compression_on_image_upload = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] allowed_direct_url_schemes = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] api_rate_limit = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] auth_strategy = keystone {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_availability_zone = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_host = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_stats_polling_interval = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backup_api_class = cinder.backup.api.API {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backup_name_template = backup-%s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backup_use_same_host = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backup_use_temp_snapshot = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] chap_password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] chap_username = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_internal_tenant_project_id = 96e82c306c544dcfa542e75e30f12ec5 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_internal_tenant_user_id = c30daadb77994244a28937203604ee27 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cluster = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] compression_format = gzip {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] compute_api_class = cinder.compute.nova.API {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] config_dir = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] config_source = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] control_exchange = openstack {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] debug = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] default_availability_zone = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] default_group_type = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] default_volume_type = QuobyteHD {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] disk_geometry = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] driver_client_cert = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] driver_client_cert_key = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] driver_data_namespace = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] driver_ssl_cert_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] driver_ssl_cert_verify = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] driver_use_ssl = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] enable_new_services = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] enable_unsupported_driver = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] enabled_backends = ['QuobyteHD'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] enforce_multipath_for_image_xfer = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] filter_function = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_api_insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_api_servers = ['http://192.168.122.150/image'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_api_ssl_compression = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_ca_certificates_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_catalog_info = image:glance:publicURL {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_num_retries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance_request_timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] goodness_function = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] graceful_shutdown_timeout = 5 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] group_api_class = cinder.group.api.API {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] host = devstack {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_compress_on_upload = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_conversion_address_space_limit = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_conversion_cpu_limit = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_conversion_disable = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_introspection_address_space_limit = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_introspection_cpu_limit = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_upload_use_cinder_backend = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_upload_use_internal_tenant = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_volume_cache_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_volume_cache_max_count = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] image_volume_cache_max_size_gb = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] init_host_max_objects_retrieval = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] instance_format = [instance: %(uuid)s] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] iscsi_target_flags = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] iscsi_write_cache = on {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] iser_helper = tgtadm {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] iser_ip_address = 192.168.122.150 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] iser_port = 3260 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_color = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_config_append = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_dir = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86841) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_options = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_rotate_interval = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_rotate_interval_type = days {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] log_rotation_type = none {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] max_age = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] max_logfile_count = 30 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] max_logfile_size_mb = 200 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] max_over_subscription_ratio = 20.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] message_reap_interval = 86400 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] message_ttl = 2592000 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] migration_create_volume_timeout_secs = 300 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] monkey_patch = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] monkey_patch_modules = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] my_ip = 192.168.122.150 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] no_snapshot_gb_quota = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] num_iser_scan_tries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] num_shell_tries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] num_volume_device_scan_tries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] nvmeof_conn_info_version = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] nvmet_ns_id = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] nvmet_port_id = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_max_limit = 1000 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_volume_ext_list = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_volume_listen_port = 8776 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_volume_use_ssl = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] osapi_volume_workers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] per_volume_size_limit = -1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] periodic_fuzzy_delay = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] periodic_interval = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] public_endpoint = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] publish_errors = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_backup_gigabytes = 1000 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_backups = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_gigabytes = 1000 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_groups = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_snapshots = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] quota_volumes = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] rate_limit_burst = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] rate_limit_except_level = CRITICAL {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] rate_limit_interval = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] reinit_driver_count = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] replication_device = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] report_discard_supported = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] report_interval = 120 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] reservation_clean_interval = 86400 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] reservation_expire = 86400 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] reserved_image_namespaces = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] reserved_percentage = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] rpc_response_timeout = 120 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] run_external_periodic_tasks = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] scst_target_driver = iscsi {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] scst_target_iqn_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_down_time = 720 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] shell_completion = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] snapshot_name_template = snapshot-%s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] split_loggers = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] state_path = /opt/stack/data/cinder {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] storage_availability_zone = nova {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] storage_protocol = iSCSI {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] syslog_log_facility = LOG_USER {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] target_helper = lioadm {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] target_ip_address = 192.168.122.150 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] target_port = 3260 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] target_protocol = iscsi {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] target_secondary_ip_addresses = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] trace_flags = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] transport_url = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] until_refresh = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_chap_auth = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_default_quota_class = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_journal = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_json = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_multipath_for_image_xfer = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_stderr = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] use_syslog = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] verify_glance_signatures = enabled {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_api_class = cinder.volume.api.API {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_backend_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_clear = zero {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_clear_ionice = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_clear_size = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_copy_bps_limit = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_dd_blocksize = 1M {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_name_template = volume-%s {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_service_inithost_offload = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volume_usage_audit_period = month {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] zoning_mode = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_concurrency.disable_process_locking = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.auth_section = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.auth_type = password {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.auth_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.cache = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.include_service_catalog = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.interface = public {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcache_username = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.region_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.service_type = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.150/identity {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.backend = dogpile.cache.null {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.backend_argument = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.backend_expiration_time = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.config_prefix = cache.oslo {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86841) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 03 18:20:58 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.debug_cache_backend = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.enable_retry_client = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.enable_socket_keepalive = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.expiration_time = 600 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.hashclient_retry_attempts = 2 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_dead_retry = 300 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_pool_maxsize = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_sasl_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.proxies = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.redis_db = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.redis_server = localhost:6379 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.retry_attempts = 2 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.retry_delay = 0.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.socket_keepalive_count = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.socket_keepalive_idle = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.socket_keepalive_interval = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.socket_timeout = 1.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.tls_allowed_ciphers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.tls_cafile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.tls_certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.tls_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.tls_keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cache.username = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] coordination.backend_url = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.asyncio_connection = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.asyncio_slave_connection = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.backend = sqlalchemy {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.connection = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.connection_debug = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.connection_parameters = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.connection_recycle_time = 3600 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.connection_trace = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.db_inc_retry_interval = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.db_max_retries = 20 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.db_max_retry_interval = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.db_retry_interval = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.max_overflow = 50 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.max_pool_size = 5 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.max_retries = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.mysql_wsrep_sync_wait = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.pool_timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.retry_interval = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.slave_connection = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.sqlite_synchronous = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.synchronous_reader = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] database.use_db_reconnect = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_tracing.insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.connection_string = messaging:// {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.es_doc_type = notification {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.es_scroll_size = 10000 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.es_scroll_time = 2m {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.filter_error_trace = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.hmac_keys = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.sentinel_service_name = mymaster {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.socket_timeout = 0.1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.trace_requests = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler.trace_sqlalchemy = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler_jaeger.process_tags = {} {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler_jaeger.service_name_prefix = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] profiler_otlp.service_name_prefix = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.enforce_new_defaults = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.policy_default_rule = default {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.policy_file = policy.yaml {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack quobyte-client[86842]: Reading configuration file: /etc/quobyte/client.cfg Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.group = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.helper_command = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack quobyte-client[86842]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] privsep_osbrick.user = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.group = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.helper_command = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] cinder_sys_admin.user = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.auth_section = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.auth_type = password {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.cafile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.collect_timing = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.send_service_user_token = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.split_loggers = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.tls_ciphers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] service_user.tls_min_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.auth_section = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.auth_type = password {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.collect_timing = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.region_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.split_loggers = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.tls_ciphers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] glance.tls_min_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.backend_availability_zone = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.chap_password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.chap_username = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.disk_geometry = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.driver_client_cert = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.driver_client_cert_key = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.driver_data_namespace = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.driver_use_ssl = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.extra_capabilities = {} {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.filter_function = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.goodness_function = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.iscsi_target_flags = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.iscsi_write_cache = on {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.iser_helper = tgtadm {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.iser_ip_address = 192.168.122.150 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.iser_port = 3260 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_host = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_login = admin {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_mount_options = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_private_key = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_share_path = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.num_shell_tries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.quobyte_volume_url = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.replication_device = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.report_discard_supported = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.reserved_percentage = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.target_helper = tgtadm {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.target_ip_address = 192.168.122.150 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.target_port = 3260 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.target_protocol = iscsi {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.trace_flags = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.unique_fqdn_network = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.use_chap_auth = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_backend_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_clear = zero {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_clear_ionice = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_clear_size = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_reports.file_event_handler = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_reports.log_dir = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.backend_availability_zone = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.backend_host = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.chap_password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.chap_username = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.chiscsi_conf = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.disk_geometry = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.driver_client_cert = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.driver_data_namespace = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.driver_use_ssl = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.extra_capabilities = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.filter_function = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.goodness_function = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.iser_helper = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.iser_ip_address = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.iser_port = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.iser_target_prefix = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_host = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_login = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_mount_options = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_password = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_private_key = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_share_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_ssh_port = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.num_shell_tries = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.nvmet_port_id = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.replication_device = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.report_discard_supported = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.reserved_percentage = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.scst_target_driver = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.storage_protocol = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.target_helper = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.target_ip_address = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.target_port = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.target_prefix = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.target_protocol = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.trace_flags = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.use_chap_auth = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_clear = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_clear_size = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] QuobyteHD.volumes_dir = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_notifications.driver = [] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_notifications.retry = -1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] key_manager.fixed_key = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.barbican_api_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.barbican_endpoint = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.barbican_endpoint_type = public {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.barbican_region_name = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.cafile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.collect_timing = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.number_of_retries = 60 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.retry_delay = 1 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.send_service_user_token = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.split_loggers = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.tls_ciphers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.tls_min_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.verify_ssl = True {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican.verify_ssl_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.auth_section = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.auth_type = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.cafile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.certfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.collect_timing = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.insecure = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.keyfile = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.split_loggers = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.timeout = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.tls_ciphers = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] barbican_service_user.tls_min_version = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.approle_role_id = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.approle_secret_id = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.auth_method = approle {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.auth_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.kv_mountpoint = secret {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.kv_path = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.kv_version = 2 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.namespace = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.root_token_id = **** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.ssl_ca_crt_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.timeout = 60.0 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.token_file = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.token_role = None {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.use_ssl = False {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 03 18:20:58 devstack cinder-volume[86541]: DEBUG oslo_service.backend._eventlet.service [None req-ec22dfc1-ace2-495a-9902-7ae40c624540 None None] ******************************************************************************** {{(pid=86541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 03 18:20:58 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.253s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:58 devstack cinder-volume[86841]: INFO cinder.volume.driver [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Driver hasn't implemented _init_vendor_properties() Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.driver [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86841) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_db.sqlalchemy.engines [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writer thread running {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.db.api [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Building query based on filter {{(pid=86841) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86841) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:58 devstack cinder-volume[86841]: INFO cinder.keymgr.migration [None req-8c186d95-0c63-423f-897a-8c5b05e73a12 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 03 18:20:58 devstack sudo[86856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:58 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:59 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.242s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:20:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Driver initialization completed successfully. Nov 03 18:20:59 devstack cinder-volume[86841]: INFO cinder.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Initiating service 3 cleanup Nov 03 18:20:59 devstack cinder-volume[86841]: INFO cinder.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Service 3 cleanup completed. Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.service [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Creating RPC server for service cinder-volume {{(pid=86841) start /opt/stack/cinder/cinder/service.py:231}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.service [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86841) start /opt/stack/cinder/cinder/service.py:237}} Nov 03 18:20:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:20:59 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:20:59 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:20:59 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.243s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:20:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-86e8028e-1852-465f-8ab4-62d2e575c2d8 None None] Driver post RPC initialization completed successfully. Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 6 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:20:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:21:08 devstack cinder-volume[86541]: DEBUG dbcounter [-] [86541] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86541) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:21:09 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:21:09 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Flow 'volume_create_manager' (ebf1fca5-d75d-40c7-b525-91933bacd86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d713d77-dd36-4eae-813a-88fa8634cf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d713d77-dd36-4eae-813a-88fa8634cf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1912108005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944acd1d-d83c-46d0-9f95-9c376f10f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3f5a7c536e43028cbc54a073b79726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:21:57Z,use_quota=True,user_id='9f22393bd25543879ccc999b4d17ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1a7063-8ae6-46ac-8633-fa81aa705cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1a7063-8ae6-46ac-8633-fa81aa705cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bb4db4-3670-44e7-baa8-b0dfe5f188c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bb4db4-3670-44e7-baa8-b0dfe5f188c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944acd1d-d83c-46d0-9f95-9c376f10f8d4', 'volume_name': 'volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce00b463-2b6d-4ff4-9692-bba45a102e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce00b463-2b6d-4ff4-9692-bba45a102e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0a91af-6e0b-4afc-a60e-431213d050c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:21:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Volume 944acd1d-d83c-46d0-9f95-9c376f10f8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4', 'volume_size': 1} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1912108005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944acd1d-d83c-46d0-9f95-9c376f10f8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3f5a7c536e43028cbc54a073b79726',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:21:57Z,use_quota=True,user_id='9f22393bd25543879ccc999b4d17ce9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Creating volume 944acd1d-d83c-46d0-9f95-9c376f10f8d4 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:21:57 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:21:57 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 1073741824 Nov 03 18:21:57 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:21:57 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 1073741824" returned: 0 in 0.515s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:21:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:21:57 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 Nov 03 18:21:57 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:21:58 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4" returned: 0 in 0.267s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0a91af-6e0b-4afc-a60e-431213d050c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b6c854-b641-4fca-8ee4-63478931f012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:21:58 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Volume volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 (944acd1d-d83c-46d0-9f95-9c376f10f8d4): created successfully Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b6c854-b641-4fca-8ee4-63478931f012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:21:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Flow 'volume_create_manager' (ebf1fca5-d75d-40c7-b525-91933bacd86a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:21:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-790a499e-2a57-4a46-bbd4-45b2d6747b7d tempest-TaggedAttachmentsTest-922865853 None] Created volume successfully. Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:21:59 devstack sudo[87565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:21:59 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:21:59 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.395s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 6 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:21:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:22:08 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:22:08 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Flow 'volume_create_manager' (442995ab-35eb-44b5-ab5c-ce6abd17b0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9418ae0a-76d5-4b84-95b4-106e1be73fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9418ae0a-76d5-4b84-95b4-106e1be73fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-765741069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c444c5-7bf8-479e-ad07-ba9b5a7ee917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb08f2490bf443cbf31e70b985d07ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:26Z,use_quota=True,user_id='87a18e033f0f49f9af0c8ccb26ca8e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23b4324-dc3d-43e3-b640-5fe10cc18e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23b4324-dc3d-43e3-b640-5fe10cc18e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9a38d7-2203-4a39-8290-a05430f59ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9a38d7-2203-4a39-8290-a05430f59ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c444c5-7bf8-479e-ad07-ba9b5a7ee917', 'volume_name': 'volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0a7e44-fa11-4f5b-9f3e-9f4921f78d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0a7e44-fa11-4f5b-9f3e-9f4921f78d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89186e7f-59b1-45e8-b4b2-4029ab4f1f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Volume c4c444c5-7bf8-479e-ad07-ba9b5a7ee917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917', 'volume_size': 1} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-765741069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c444c5-7bf8-479e-ad07-ba9b5a7ee917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb08f2490bf443cbf31e70b985d07ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:26Z,use_quota=True,user_id='87a18e033f0f49f9af0c8ccb26ca8e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Creating volume c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:22:26 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:22:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:26 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 1073741824 Nov 03 18:22:26 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:27 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 1073741824" returned: 0 in 1.173s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:27 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 Nov 03 18:22:27 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:28 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917" returned: 0 in 0.483s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89186e7f-59b1-45e8-b4b2-4029ab4f1f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b968de-04c1-44bb-9859-e39cf6f20bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:28 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Volume volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 (c4c444c5-7bf8-479e-ad07-ba9b5a7ee917): created successfully Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b968de-04c1-44bb-9859-e39cf6f20bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Flow 'volume_create_manager' (442995ab-35eb-44b5-ab5c-ce6abd17b0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:22:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-aa7ee8d0-40f5-4f3b-ade7-59e0b7bd8681 tempest-VolumesAdminNegativeTest-1081907594 None] Created volume successfully. Nov 03 18:22:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Acquiring lock "cinder-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:22:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Lock "cinder-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:22:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Acquiring lock "cinder-quobyte-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:22:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Lock "cinder-quobyte-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917" acquired by "delete_volume" :: waited 0.056s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:22:29 devstack cinder-volume[86841]: INFO oslo.privsep.daemon [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpp3dm398b/privsep.sock'] Nov 03 18:22:29 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpp3dm398b/privsep.sock Nov 03 18:22:29 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: Nov 03 18:22:31 devstack cinder-volume[86841]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 03 18:22:31 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:31 devstack cinder-volume[86841]: INFO oslo.privsep.daemon [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Spawned new privsep daemon via rootwrap Nov 03 18:22:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Accepted privsep connection to /tmp/tmpp3dm398b/privsep.sock {{(pid=86841) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 03 18:22:31 devstack cinder-volume[86841]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 03 18:22:31 devstack cinder-volume[86841]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 03 18:22:31 devstack cinder-volume[86841]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 03 18:22:31 devstack cinder-volume[86841]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88026 Nov 03 18:22:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbfe7e2-9a7a-4f75-92b8-49975c2f78bb]: (2,) {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:22:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[403df698-95fc-4c2a-a468-790be2cc0105]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:22:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:31 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 Nov 03 18:22:31 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:32 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917" returned: 0 in 0.565s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:32 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917 Nov 03 18:22:32 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:32 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Lock "cinder-quobyte-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917" released by "delete_volume" :: held 3.261s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:22:32 devstack cinder-volume[86841]: WARNING cinder.quota [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:22:32 devstack cinder-volume[86841]: WARNING cinder.quota [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Created reservations ['ef14959c-9e1b-4d3d-b301-23012261f471', '03ddbabe-3313-43fa-9f0f-c35d50287aa4', 'ddf1a340-36ac-421d-8a5d-2b27e2d8ad06', '87be1f74-f37c-4826-a9ea-953d7dcc3341'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:22:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:32 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:22:32 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:33 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.428s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:33 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:22:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Deleted volume successfully. Nov 03 18:22:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7104753f-04eb-4591-9e84-054a36091dab tempest-VolumesAdminNegativeTest-1081907594 None] Lock "cinder-c4c444c5-7bf8-479e-ad07-ba9b5a7ee917-delete_volume" released by "delete_volume" :: held 4.260s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Flow 'volume_create_manager' (e43aaad9-6cda-41ea-bd20-0c5f816613e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9ae642-062c-4a8a-bf9e-61e5a430020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b9ae642-062c-4a8a-bf9e-61e5a430020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1183637083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739e32e3-c5d8-4160-b342-498492463fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b1bc244df242148b4cab34fe9fd333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:41Z,use_quota=True,user_id='7200d1ddf1884aa39c71b2750f5b94a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fe43cb-19c2-446a-92a6-d40a440c6ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35fe43cb-19c2-446a-92a6-d40a440c6ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938cb3bd-94c4-439d-b4b7-705f91bb2c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938cb3bd-94c4-439d-b4b7-705f91bb2c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739e32e3-c5d8-4160-b342-498492463fd1', 'volume_name': 'volume-739e32e3-c5d8-4160-b342-498492463fd1', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37ae942-0b3f-4e86-a68f-305bd816df45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37ae942-0b3f-4e86-a68f-305bd816df45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4530d4-2992-4be4-a91b-667bfc174044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Volume 739e32e3-c5d8-4160-b342-498492463fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739e32e3-c5d8-4160-b342-498492463fd1', 'volume_size': 1} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1183637083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739e32e3-c5d8-4160-b342-498492463fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b1bc244df242148b4cab34fe9fd333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:22:41Z,use_quota=True,user_id='7200d1ddf1884aa39c71b2750f5b94a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Creating volume 739e32e3-c5d8-4160-b342-498492463fd1 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:22:40 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:22:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:40 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 1073741824 Nov 03 18:22:40 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:41 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 1073741824" returned: 0 in 0.776s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:22:41 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 Nov 03 18:22:41 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:22:42 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1" returned: 0 in 0.485s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4530d4-2992-4be4-a91b-667bfc174044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739e32e3-c5d8-4160-b342-498492463fd1', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ab4e1-eba2-4f7b-bebd-57cfdbd5d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:22:42 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Volume volume-739e32e3-c5d8-4160-b342-498492463fd1 (739e32e3-c5d8-4160-b342-498492463fd1): created successfully Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ab4e1-eba2-4f7b-bebd-57cfdbd5d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:22:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Flow 'volume_create_manager' (e43aaad9-6cda-41ea-bd20-0c5f816613e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:22:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8c3973ce-2788-4a5b-aabe-7fa3a3298aa2 tempest-ServerActionsTestOtherA-2004651196 None] Created volume successfully. Nov 03 18:22:52 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=11,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:22:52 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=16,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=3 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:22:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:22:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 8 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:22:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Flow 'volume_create_manager' (040c9490-9719-442a-89f1-f21cd127dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de4647f-96bb-47c0-8d93-971658c38620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de4647f-96bb-47c0-8d93-971658c38620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-311942547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aee087d-5336-4602-8b61-312e9ee3bf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911f899974f3405a876469303584ada6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:04Z,use_quota=True,user_id='ae6bc74d186e4d5c9a9dc0dc085da93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84f21e6-f969-42d4-a24d-c8aa1bce696a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84f21e6-f969-42d4-a24d-c8aa1bce696a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d966d0d9-edc3-44b1-a0dc-8561dc07dbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d966d0d9-edc3-44b1-a0dc-8561dc07dbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aee087d-5336-4602-8b61-312e9ee3bf9d', 'volume_name': 'volume-2aee087d-5336-4602-8b61-312e9ee3bf9d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd916a16-8674-4d8f-9786-8c24cae76ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd916a16-8674-4d8f-9786-8c24cae76ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3489fd7-d91b-4ab9-adc1-653e6b1ee049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Volume 2aee087d-5336-4602-8b61-312e9ee3bf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aee087d-5336-4602-8b61-312e9ee3bf9d', 'volume_size': 1} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-311942547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aee087d-5336-4602-8b61-312e9ee3bf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911f899974f3405a876469303584ada6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:04Z,use_quota=True,user_id='ae6bc74d186e4d5c9a9dc0dc085da93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Creating volume 2aee087d-5336-4602-8b61-312e9ee3bf9d {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:23:04 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:23:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:04 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d 1073741824 Nov 03 18:23:04 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:05 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d 1073741824" returned: 0 in 1.194s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:05 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d Nov 03 18:23:05 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:06 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d" returned: 0 in 0.901s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3489fd7-d91b-4ab9-adc1-653e6b1ee049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aee087d-5336-4602-8b61-312e9ee3bf9d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26133a6-b2ce-4bd1-8c52-34aee5bbf42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:06 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Volume volume-2aee087d-5336-4602-8b61-312e9ee3bf9d (2aee087d-5336-4602-8b61-312e9ee3bf9d): created successfully Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26133a6-b2ce-4bd1-8c52-34aee5bbf42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Flow 'volume_create_manager' (040c9490-9719-442a-89f1-f21cd127dc47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:23:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9536f249-ea3e-49a7-bd8a-39126949f05e tempest-DeleteServersTestJSON-1194521549 None] Created volume successfully. Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Flow 'volume_create_manager' (d5f3b76d-d518-4d07-bcec-4cd14071e59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d419ece0-4eae-438a-939c-bc0ef68f06f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d419ece0-4eae-438a-939c-bc0ef68f06f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-107873060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a0f28a-c418-4371-945a-21a48ee891e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd3435813584a4bab497b6fe90d0a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:09Z,use_quota=True,user_id='2c9f29617abe4bb9b44859ddf680fe04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e466b544-333f-47d2-91f9-5983dc7e4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e466b544-333f-47d2-91f9-5983dc7e4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4329d6d6-b532-4176-85c2-832506043558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4329d6d6-b532-4176-85c2-832506043558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a0f28a-c418-4371-945a-21a48ee891e5', 'volume_name': 'volume-33a0f28a-c418-4371-945a-21a48ee891e5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b8706f-037e-4798-ab43-6396ba650077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b8706f-037e-4798-ab43-6396ba650077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55090dc-be9f-4054-8101-28a7c7b72862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:08 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Volume 33a0f28a-c418-4371-945a-21a48ee891e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a0f28a-c418-4371-945a-21a48ee891e5', 'volume_size': 1} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-107873060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a0f28a-c418-4371-945a-21a48ee891e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4cd3435813584a4bab497b6fe90d0a62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:09Z,use_quota=True,user_id='2c9f29617abe4bb9b44859ddf680fe04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Creating volume 33a0f28a-c418-4371-945a-21a48ee891e5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:23:08 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:23:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:08 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 1073741824 Nov 03 18:23:08 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:09 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 1073741824" returned: 0 in 0.630s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:09 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 Nov 03 18:23:09 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:10 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5" returned: 0 in 0.674s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55090dc-be9f-4054-8101-28a7c7b72862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a0f28a-c418-4371-945a-21a48ee891e5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef52bc2-e12a-44c1-9c28-b6a95ff912b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Volume volume-33a0f28a-c418-4371-945a-21a48ee891e5 (33a0f28a-c418-4371-945a-21a48ee891e5): created successfully Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef52bc2-e12a-44c1-9c28-b6a95ff912b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Flow 'volume_create_manager' (d5f3b76d-d518-4d07-bcec-4cd14071e59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:23:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-028a374d-a36a-45db-91e7-b5b75633d042 req-237aef31-3f3c-4444-9b1d-c151854fcb2f tempest-VolumesGetTestJSON-1874681746 None] Created volume successfully. Nov 03 18:23:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Acquiring lock "cinder-33a0f28a-c418-4371-945a-21a48ee891e5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Lock "cinder-33a0f28a-c418-4371-945a-21a48ee891e5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Acquiring lock "cinder-quobyte-33a0f28a-c418-4371-945a-21a48ee891e5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Lock "cinder-quobyte-33a0f28a-c418-4371-945a-21a48ee891e5" acquired by "delete_volume" :: waited 0.040s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:11 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf3f0a-16fc-429b-83fe-b0493f8d97da]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:12 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 Nov 03 18:23:12 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:12 devstack cinder-volume[86841]: WARNING py.warnings [req-7cfc71b9-a599-448b-b0ea-4091396958ca req-f09fb604-de66-49c9-a7b0-44fc81fad16e tempest-TaggedAttachmentsTest-922865853 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 03 18:23:12 devstack cinder-volume[86841]: .first() Nov 03 18:23:12 devstack cinder-volume[86841]: Nov 03 18:23:12 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5" returned: 0 in 0.654s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-7cfc71b9-a599-448b-b0ea-4091396958ca req-f09fb604-de66-49c9-a7b0-44fc81fad16e tempest-TaggedAttachmentsTest-922865853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-7cfc71b9-a599-448b-b0ea-4091396958ca req-f09fb604-de66-49c9-a7b0-44fc81fad16e tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:12 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5 Nov 03 18:23:12 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-7cfc71b9-a599-448b-b0ea-4091396958ca req-f09fb604-de66-49c9-a7b0-44fc81fad16e tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-dbd301e0-d186-45f7-bbea-de59fce1c667 req-62d09560-a7d6-4b44-8a25-d1de986f09ad tempest-DeleteServersTestJSON-1194521549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-dbd301e0-d186-45f7-bbea-de59fce1c667 req-62d09560-a7d6-4b44-8a25-d1de986f09ad tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-7cfc71b9-a599-448b-b0ea-4091396958ca req-f09fb604-de66-49c9-a7b0-44fc81fad16e tempest-TaggedAttachmentsTest-922865853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b02c533-a7e9-4ca0-b8f1-7ad47421a978', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-dbd301e0-d186-45f7-bbea-de59fce1c667 req-62d09560-a7d6-4b44-8a25-d1de986f09ad tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-dbd301e0-d186-45f7-bbea-de59fce1c667 req-62d09560-a7d6-4b44-8a25-d1de986f09ad tempest-DeleteServersTestJSON-1194521549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-2aee087d-5336-4602-8b61-312e9ee3bf9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38c8fea3-a4c1-457c-ae2b-396b91c0d3a2', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:23:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-7cfc71b9-a599-448b-b0ea-4091396958ca req-f09fb604-de66-49c9-a7b0-44fc81fad16e tempest-TaggedAttachmentsTest-922865853 None] attachment_update completed successfully. Nov 03 18:23:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-dbd301e0-d186-45f7-bbea-de59fce1c667 req-62d09560-a7d6-4b44-8a25-d1de986f09ad tempest-DeleteServersTestJSON-1194521549 None] attachment_update completed successfully. Nov 03 18:23:12 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-33a0f28a-c418-4371-945a-21a48ee891e5" returned: 0 in 0.475s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Lock "cinder-quobyte-33a0f28a-c418-4371-945a-21a48ee891e5" released by "delete_volume" :: held 1.208s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG cinder.quota [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Created reservations ['f975bd26-5bf4-47e8-9f7d-9e03873e0204', '3da1a93b-7e92-42d2-a511-b78847e0c681', '9f825565-9280-444b-a198-e1c8112d2010', 'b9bc2584-cb9b-4e6b-b598-a2d2a201616f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:13 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:23:13 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:13 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.491s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG cinder.manager [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:23:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Deleted volume successfully. Nov 03 18:23:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-5631b282-2097-473b-adc9-0d76c644ba6f req-f2fd725c-9772-4a26-9c9f-bd4eaae0e110 tempest-VolumesGetTestJSON-1874681746 None] Lock "cinder-33a0f28a-c418-4371-945a-21a48ee891e5-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-32593775-4c35-4508-b2d4-590e91a4a346 req-52e49fd6-1c72-4f07-9fc1-4c96624f6bc7 tempest-TaggedAttachmentsTest-922865853 None] Terminate volume connection completed successfully. Nov 03 18:23:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-32593775-4c35-4508-b2d4-590e91a4a346 req-52e49fd6-1c72-4f07-9fc1-4c96624f6bc7 tempest-TaggedAttachmentsTest-922865853 None] Deleting attachment 8b02c533-a7e9-4ca0-b8f1-7ad47421a978. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:23:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-1ed3df84-335f-4f1c-8aa0-731dc5c08f20 req-bbdf6223-a502-4368-8173-ca3219e09da6 tempest-DeleteServersTestJSON-1194521549 None] Terminate volume connection completed successfully. Nov 03 18:23:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-1ed3df84-335f-4f1c-8aa0-731dc5c08f20 req-bbdf6223-a502-4368-8173-ca3219e09da6 tempest-DeleteServersTestJSON-1194521549 None] Deleting attachment 38c8fea3-a4c1-457c-ae2b-396b91c0d3a2. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Acquiring lock "cinder-2aee087d-5336-4602-8b61-312e9ee3bf9d-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Lock "cinder-2aee087d-5336-4602-8b61-312e9ee3bf9d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Acquiring lock "cinder-quobyte-2aee087d-5336-4602-8b61-312e9ee3bf9d" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Lock "cinder-quobyte-2aee087d-5336-4602-8b61-312e9ee3bf9d" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39b751-660d-48e1-a399-a1a3596df901]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:19 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d Nov 03 18:23:19 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:19 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d" returned: 0 in 0.427s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:19 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d Nov 03 18:23:19 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:19 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2aee087d-5336-4602-8b61-312e9ee3bf9d" returned: 0 in 0.317s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Lock "cinder-quobyte-2aee087d-5336-4602-8b61-312e9ee3bf9d" released by "delete_volume" :: held 0.808s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Created reservations ['c201ce6c-2948-4e3f-8300-a70e7328d7b8', 'bae8c0b6-c657-4ea5-86da-f72aecfdb4a0', 'cf3bf0dd-3463-4aea-8c06-e8c9f72f0e2b', '1bdf6153-3118-4590-b8f4-2db68140bc4e'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:20 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:23:20 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:20 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.314s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:23:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Deleted volume successfully. Nov 03 18:23:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-24c9bc2b-1ed5-4f3e-ad56-61ba8a01ca79 tempest-DeleteServersTestJSON-1194521549 None] Lock "cinder-2aee087d-5336-4602-8b61-312e9ee3bf9d-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3f5d6e34-e68c-4c83-8e57-2912ffaf0163 tempest-GroupSnapshotsV319Test-895111138 None] Group tempest-GroupSnapshotsV319Test-Group-1967465302: creating Nov 03 18:23:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3f5d6e34-e68c-4c83-8e57-2912ffaf0163 tempest-GroupSnapshotsV319Test-895111138 None] Group tempest-GroupSnapshotsV319Test-Group-1967465302: created successfully Nov 03 18:23:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3f5d6e34-e68c-4c83-8e57-2912ffaf0163 tempest-GroupSnapshotsV319Test-895111138 None] Create group completed successfully. Nov 03 18:23:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Acquiring lock "cinder-944acd1d-d83c-46d0-9f95-9c376f10f8d4-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Lock "cinder-944acd1d-d83c-46d0-9f95-9c376f10f8d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Acquiring lock "cinder-quobyte-944acd1d-d83c-46d0-9f95-9c376f10f8d4" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Lock "cinder-quobyte-944acd1d-d83c-46d0-9f95-9c376f10f8d4" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e908bb0-6a6a-4d01-8582-33d575996c18]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:27 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 Nov 03 18:23:27 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:28 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4" returned: 0 in 0.447s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:28 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4 Nov 03 18:23:28 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:28 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-944acd1d-d83c-46d0-9f95-9c376f10f8d4" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Lock "cinder-quobyte-944acd1d-d83c-46d0-9f95-9c376f10f8d4" released by "delete_volume" :: held 0.876s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Created reservations ['a8797881-e31a-4128-b4fd-08dc6f724708', 'a722ea9c-a204-455c-8084-c2fe17162d08', '4e3843a0-9ac0-4987-a0bd-eb9d7e4cbe68', 'a3045780-274d-462f-b464-4924a1c0ac78'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Flow 'volume_create_manager' (630a92d8-0157-4166-837a-d01589094c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb060d4-4d68-4951-9858-d74b2fada864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:28 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:23:28 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb060d4-4d68-4951-9858-d74b2fada864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370497546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aeaa0df-4602-4f95-841a-cc95b31d0a5c,host='devstack@QuobyteHD#QuobyteHD',id=a41a267a-a410-4e0f-aadb-344cf457084f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e1499e251f45069e47f4f91b5b077a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:29Z,use_quota=True,user_id='8ed0bf2ae9754c078e6dd0424a706ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(672420e3-126f-40de-b469-d61c2ec26e16),volume_type_id=672420e3-126f-40de-b469-d61c2ec26e16)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce3c952-a02b-45bf-8959-7fbdfc509508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce3c952-a02b-45bf-8959-7fbdfc509508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26c3ab4-0871-4634-a240-a738c08c4071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26c3ab4-0871-4634-a240-a738c08c4071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41a267a-a410-4e0f-aadb-344cf457084f', 'volume_name': 'volume-a41a267a-a410-4e0f-aadb-344cf457084f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096c1e53-8e91-4681-baff-5f452ed79b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096c1e53-8e91-4681-baff-5f452ed79b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475422bf-c97d-4415-95e4-8de4936da908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Volume a41a267a-a410-4e0f-aadb-344cf457084f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41a267a-a410-4e0f-aadb-344cf457084f', 'volume_size': 1} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2aeaa0df-4602-4f95-841a-cc95b31d0a5c,created_at=2026-11-03T17:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370497546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2aeaa0df-4602-4f95-841a-cc95b31d0a5c,host='devstack@QuobyteHD#QuobyteHD',id=a41a267a-a410-4e0f-aadb-344cf457084f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e1499e251f45069e47f4f91b5b077a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:23:29Z,use_quota=True,user_id='8ed0bf2ae9754c078e6dd0424a706ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(672420e3-126f-40de-b469-d61c2ec26e16),volume_type_id=672420e3-126f-40de-b469-d61c2ec26e16)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Creating volume a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:23:29 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:29 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f 1073741824 Nov 03 18:23:29 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:29 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.283s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:23:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Deleted volume successfully. Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-154c4bd3-b404-49fa-b485-4f7abaee35cf tempest-TaggedAttachmentsTest-922865853 None] Lock "cinder-944acd1d-d83c-46d0-9f95-9c376f10f8d4-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:29 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f 1073741824" returned: 0 in 0.721s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:29 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f Nov 03 18:23:29 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-998768da-7432-48a5-b93d-498c6e15edb9 req-28372fb4-855b-4501-9021-2eafc1a21f76 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:30 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f" returned: 0 in 0.385s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-998768da-7432-48a5-b93d-498c6e15edb9 req-28372fb4-855b-4501-9021-2eafc1a21f76 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.347s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475422bf-c97d-4415-95e4-8de4936da908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41a267a-a410-4e0f-aadb-344cf457084f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32b0ed2-99ac-4dbf-bbce-2df4e230c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-998768da-7432-48a5-b93d-498c6e15edb9 req-28372fb4-855b-4501-9021-2eafc1a21f76 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Volume volume-a41a267a-a410-4e0f-aadb-344cf457084f (a41a267a-a410-4e0f-aadb-344cf457084f): created successfully Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32b0ed2-99ac-4dbf-bbce-2df4e230c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Flow 'volume_create_manager' (630a92d8-0157-4166-837a-d01589094c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:23:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-254d07e6-da3b-4042-8d03-6a00a046abe4 tempest-GroupSnapshotsV319Test-895111138 None] Created volume successfully. Nov 03 18:23:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-998768da-7432-48a5-b93d-498c6e15edb9 req-28372fb4-855b-4501-9021-2eafc1a21f76 tempest-ServerActionsTestOtherA-2004651196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-739e32e3-c5d8-4160-b342-498492463fd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba122547-f98e-4231-93fe-60df99908f36', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:23:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-998768da-7432-48a5-b93d-498c6e15edb9 req-28372fb4-855b-4501-9021-2eafc1a21f76 tempest-ServerActionsTestOtherA-2004651196 None] attachment_update completed successfully. Nov 03 18:23:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] GroupSnapshot 4853bd22-57d7-486e-8f68-aca3562ff07e: creating. Nov 03 18:23:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Group snapshot 4853bd22-57d7-486e-8f68-aca3562ff07e: creating. {{(pid=86841) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 18:23:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Creating offline snapshot f8414895-2850-4915-a082-0f1cca414229 of volume a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:23:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0548d-d36e-4f37-9b26-788c1b40cfeb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:31 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f Nov 03 18:23:31 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:32 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:32 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 1G Nov 03 18:23:32 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:32 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 1G" returned: 0 in 0.511s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41a267a-a410-4e0f-aadb-344cf457084f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:32 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41a267a-a410-4e0f-aadb-344cf457084f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 Nov 03 18:23:32 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:33 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a41a267a-a410-4e0f-aadb-344cf457084f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229" returned: 0 in 0.369s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:33 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:33 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 Nov 03 18:23:33 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:33 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:33 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info Nov 03 18:23:33 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:33 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info" returned: 0 in 0.295s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:33 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:33 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info Nov 03 18:23:33 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:33 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.info" returned: 0 in 0.257s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d407b531-79fe-4d3c-9220-a80dac0c505b tempest-GroupSnapshotsV319Test-895111138 None] group_snapshot 4853bd22-57d7-486e-8f68-aca3562ff07e: created successfully Nov 03 18:23:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] group_snapshot 4853bd22-57d7-486e-8f68-aca3562ff07e: deleting Nov 03 18:23:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] group_snapshot 4853bd22-57d7-486e-8f68-aca3562ff07e: deleting {{(pid=86841) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 18:23:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "cinder-quobyte-a41a267a-a410-4e0f-aadb-344cf457084f" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Lock "cinder-quobyte-a41a267a-a410-4e0f-aadb-344cf457084f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "cinder-quobyte-f8414895-2850-4915-a082-0f1cca414229" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Lock "cinder-quobyte-f8414895-2850-4915-a082-0f1cca414229" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Deleting offline snapshot f8414895-2850-4915-a082-0f1cca414229 of volume a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] snapshot_file for this snap is: volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:23:36 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-84945c57-7ec8-4dc0-83f1-97fffe129da0 tempest-ServerActionsTestOtherA-2004651196 None] Terminate volume connection completed successfully. Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-84945c57-7ec8-4dc0-83f1-97fffe129da0 tempest-ServerActionsTestOtherA-2004651196 None] Deleting attachment ba122547-f98e-4231-93fe-60df99908f36. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ab1d96-1c5f-4c33-a532-fb19d3730b9f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:36 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 Nov 03 18:23:36 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:36 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229" returned: 0 in 0.722s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a41a267a-a410-4e0f-aadb-344cf457084f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[8880b0ef-3d1e-40a0-b4e5-b583be8144b9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:36 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f Nov 03 18:23:36 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-0d3d61bc-6f72-40c1-86c1-ae9f3e6abc31 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-0d3d61bc-6f72-40c1-86c1-ae9f3e6abc31 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-0d3d61bc-6f72-40c1-86c1-ae9f3e6abc31 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-0d3d61bc-6f72-40c1-86c1-ae9f3e6abc31 tempest-ServerActionsTestOtherA-2004651196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-739e32e3-c5d8-4160-b342-498492463fd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbcf0a77-d36d-49dc-ab3d-6cd9e0d5023b', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:23:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-e3d744d9-63b1-4fed-855c-dd17d1d2641d req-0d3d61bc-6f72-40c1-86c1-ae9f3e6abc31 tempest-ServerActionsTestOtherA-2004651196 None] attachment_update completed successfully. Nov 03 18:23:37 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f" returned: 0 in 0.717s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:37 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 Nov 03 18:23:37 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:38 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229" returned: 0 in 0.552s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:38 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229 Nov 03 18:23:38 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:38 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f.f8414895-2850-4915-a082-0f1cca414229" returned: 0 in 0.331s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Lock "cinder-quobyte-f8414895-2850-4915-a082-0f1cca414229" released by "_delete_snapshot" :: held 2.501s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Lock "cinder-quobyte-a41a267a-a410-4e0f-aadb-344cf457084f" released by "delete_snapshot" :: held 2.557s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:38 devstack cinder-volume[86841]: WARNING cinder.quota [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1522138718 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1522138718, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:23:38 devstack cinder-volume[86841]: WARNING cinder.quota [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1522138718 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1522138718, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:23:38 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] Created reservations ['3b4d4dcc-9bcb-4e0d-ae56-1f120fafe277', '22050a7b-2a5a-4c87-ada9-86f625e3f1ae', 'c87816ab-f852-48ed-bd29-c0600f0522a4', 'f0e835f2-3885-460c-96e5-5308e88fc05f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:23:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c8ec5a8f-2ea4-4eed-a792-0eed608812f1 tempest-GroupSnapshotsV319Test-895111138 None] group_snapshot 4853bd22-57d7-486e-8f68-aca3562ff07e: deleted successfully Nov 03 18:23:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "cinder-quobyte-a41a267a-a410-4e0f-aadb-344cf457084f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:23:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Lock "cinder-quobyte-a41a267a-a410-4e0f-aadb-344cf457084f" acquired by "delete_volume" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:23:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c64c35-4636-4e17-8e5e-ff842730ef5f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:23:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:40 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f Nov 03 18:23:40 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:40 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f" returned: 0 in 0.484s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:40 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f Nov 03 18:23:40 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:40 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a41a267a-a410-4e0f-aadb-344cf457084f" returned: 0 in 0.447s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Lock "cinder-quobyte-a41a267a-a410-4e0f-aadb-344cf457084f" released by "delete_volume" :: held 1.066s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Created reservations ['69f36e2b-d0f5-4568-9bd9-006cb87afa41'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:23:41 devstack cinder-volume[86841]: WARNING cinder.quota [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1522138718 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1522138718, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Created reservations ['8702e1b8-5dc9-45f6-996d-7aa7a23549f2', 'd879fbf2-c262-4cbc-bdea-4f84491006a3', 'bbc07a4d-e8e2-463b-b457-07421c09591e', '65ced258-a2bb-4eec-89d7-6259830d3888'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:41 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:23:41 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:41 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.462s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:41 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:23:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-339dac69-83ca-4165-842d-ceeadc03ce4d tempest-GroupSnapshotsV319Test-895111138 None] Delete group completed successfully. Nov 03 18:23:51 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=69,cinder:UPDATE=65,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:23:51 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=54,cinder:SELECT=77,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:23:59 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:23:59 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:23:59 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.356s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:23:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:24:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-fbd0d2b4-a8fd-456b-ba1d-350a031cbb78 req-9298e15c-0fcb-40a3-8113-da4cdb13c7b7 tempest-ServerActionsTestOtherA-2004651196 None] Terminate volume connection completed successfully. Nov 03 18:24:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-fbd0d2b4-a8fd-456b-ba1d-350a031cbb78 req-9298e15c-0fcb-40a3-8113-da4cdb13c7b7 tempest-ServerActionsTestOtherA-2004651196 None] Deleting attachment fbcf0a77-d36d-49dc-ab3d-6cd9e0d5023b. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:24:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-44b06f3e-f3c1-49dc-b19e-516eb2e14c84 tempest-GroupsV314Test-1759744186 None] Group tempest-GroupsV314Test-Group-212514998: creating Nov 03 18:24:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-44b06f3e-f3c1-49dc-b19e-516eb2e14c84 tempest-GroupsV314Test-1759744186 None] Group tempest-GroupsV314Test-Group-212514998: created successfully Nov 03 18:24:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-44b06f3e-f3c1-49dc-b19e-516eb2e14c84 tempest-GroupsV314Test-1759744186 None] Create group completed successfully. Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Flow 'volume_create_manager' (cd9c387b-8432-4847-9f9d-6283a4592fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11078bc-7aba-4ddf-b56d-7433519b396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11078bc-7aba-4ddf-b56d-7433519b396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160231062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d86e4c74-1a99-40d4-937d-fda601884aef,host='devstack@QuobyteHD#QuobyteHD',id=a89de2c4-f692-4c9b-a892-5306dbe07ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c7b700b104ea588c700745267ebec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:13Z,use_quota=True,user_id='43e3b1de8c8e4d829b8b5fd495257dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6e8eb03-375d-4b06-87a1-418dbf59be51),volume_type_id=d6e8eb03-375d-4b06-87a1-418dbf59be51)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401933e3-e773-4696-be95-e7ea624b2149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401933e3-e773-4696-be95-e7ea624b2149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9301124b-c147-4fdd-8d59-f6a67b0b9bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9301124b-c147-4fdd-8d59-f6a67b0b9bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89de2c4-f692-4c9b-a892-5306dbe07ab9', 'volume_name': 'volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd06b007-b889-4b5d-b7dc-4ab468a3cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd06b007-b889-4b5d-b7dc-4ab468a3cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd400f-a5b8-4ecb-9441-89a1a0d83e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Volume a89de2c4-f692-4c9b-a892-5306dbe07ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9', 'volume_size': 1} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d86e4c74-1a99-40d4-937d-fda601884aef,created_at=2026-11-03T17:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160231062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d86e4c74-1a99-40d4-937d-fda601884aef,host='devstack@QuobyteHD#QuobyteHD',id=a89de2c4-f692-4c9b-a892-5306dbe07ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='571c7b700b104ea588c700745267ebec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:13Z,use_quota=True,user_id='43e3b1de8c8e4d829b8b5fd495257dac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6e8eb03-375d-4b06-87a1-418dbf59be51),volume_type_id=d6e8eb03-375d-4b06-87a1-418dbf59be51)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Creating volume a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:24:13 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:24:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:13 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 1073741824 Nov 03 18:24:13 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:14 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 1073741824" returned: 0 in 1.129s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:14 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 Nov 03 18:24:14 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:15 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9" returned: 0 in 0.552s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd400f-a5b8-4ecb-9441-89a1a0d83e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6229f8c9-b412-47c4-9cb8-e7fb72daae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:15 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Volume volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 (a89de2c4-f692-4c9b-a892-5306dbe07ab9): created successfully Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6229f8c9-b412-47c4-9cb8-e7fb72daae82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Flow 'volume_create_manager' (cd9c387b-8432-4847-9f9d-6283a4592fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-33c4f7d9-3369-4159-aec9-79564f55b75e tempest-GroupsV314Test-1759744186 None] Created volume successfully. Nov 03 18:24:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:17 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Cloning volume a89de2c4-f692-4c9b-a892-5306dbe07ab9 to volume d9baa0b8-6b2e-4439-82e6-2c20b1598d6e Nov 03 18:24:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Creating offline snapshot 538d4deb-cfd1-4319-bcc5-a9d0cb32e2df of volume a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:24:17 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[35307580-0a64-4c1b-9ed3-5d6ca7b2961a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:17 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 Nov 03 18:24:17 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:18 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9" returned: 0 in 0.809s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:18 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df 1G Nov 03 18:24:18 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:19 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df 1G" returned: 0 in 1.062s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:19 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df Nov 03 18:24:19 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Flow 'volume_create_manager' (1850e8a2-a7b9-432a-97fd-17cb7898da43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9c73f5-30d1-4117-9146-f95c9e1b9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9c73f5-30d1-4117-9146-f95c9e1b9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-862610525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080d9f94-2056-4987-90e5-23b1f0e600c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039c850f740429abaa650079c019a0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:19Z,use_quota=True,user_id='df5e061a745a4149a7f04f0f7fdd34da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf840954-f2bb-4a84-9307-37293b7439a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf840954-f2bb-4a84-9307-37293b7439a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83db6d32-8c4a-4258-b398-e554752e8e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83db6d32-8c4a-4258-b398-e554752e8e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080d9f94-2056-4987-90e5-23b1f0e600c4', 'volume_name': 'volume-080d9f94-2056-4987-90e5-23b1f0e600c4', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2f5858-0741-4287-ad45-22247e6c44d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2f5858-0741-4287-ad45-22247e6c44d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98980af2-cb68-472c-a9c4-24a1d6ea5ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:19 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Volume 080d9f94-2056-4987-90e5-23b1f0e600c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080d9f94-2056-4987-90e5-23b1f0e600c4', 'volume_size': 1} Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:19 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" returned: 0 in 0.776s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:19 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:24:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:20 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df Nov 03 18:24:20 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:20 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" returned: 0 in 0.699s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:20 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info Nov 03 18:24:20 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:21 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info" returned: 0 in 0.524s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:21 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:21 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info Nov 03 18:24:21 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Flow 'volume_create_manager' (3de1b367-fb4e-4cf8-a168-2fb4e5fff096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0f8ca2-c7e5-49a2-bd34-7a6373b78fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d0f8ca2-c7e5-49a2-bd34-7a6373b78fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-219173722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccc8da9-c2df-4919-aa32-20193b23104a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b1bc244df242148b4cab34fe9fd333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:22Z,use_quota=True,user_id='7200d1ddf1884aa39c71b2750f5b94a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b906ca3-1204-4c2d-a640-0c6c85567e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b906ca3-1204-4c2d-a640-0c6c85567e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aaf6ca3-c620-48a1-aace-febf61aaa05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:24:21 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.info" returned: 0 in 0.394s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Acquiring lock "cinder-quobyte-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] snapshot: 538d4deb-cfd1-4319-bcc5-a9d0cb32e2df, volume: d9baa0b8-6b2e-4439-82e6-2c20b1598d6e, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5ba864-2256-4570-82ea-5a45861ad5c6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:21 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df Nov 03 18:24:21 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aaf6ca3-c620-48a1-aace-febf61aaa05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ccc8da9-c2df-4919-aa32-20193b23104a', 'volume_name': 'volume-3ccc8da9-c2df-4919-aa32-20193b23104a', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7142871-5f4e-4ce9-a603-a94b12b0a3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7142871-5f4e-4ce9-a603-a94b12b0a3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef4df5c-f058-4dcc-b05c-10de1fc665c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:22 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Volume 3ccc8da9-c2df-4919-aa32-20193b23104a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ccc8da9-c2df-4919-aa32-20193b23104a', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Trying to clone 3ccc8da9-c2df-4919-aa32-20193b23104a from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:24:22 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" returned: 0 in 0.602s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dad26d-0e1e-4b6d-83a5-d7c7f5ca70f9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:22 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 Nov 03 18:24:22 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:22 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:24:22 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Image download 20.69 MB at 20.69 MB/s Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b816f8-55f4-422c-8772-6b1f6fe9d623]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:23 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9" returned: 0 in 0.767s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:23 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD Nov 03 18:24:23 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:23 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e Nov 03 18:24:23 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:23 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD" returned: 0 in 0.896s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:23 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb is fetched for user 7200d1ddf1884aa39c71b2750f5b94a7. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:24:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ea800-11ba-4089-9d42-9353cfdc12e2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:24 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD Nov 03 18:24:24 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:25 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD" returned: 0 in 1.533s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:24:34 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" returned: 0 in 11.402s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9, size 1024.00 MB, duration 11.40 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:24:34 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Converted 1024.00 MB image at 89.80 MB/s Nov 03 18:24:34 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:34 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e Nov 03 18:24:34 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:34 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" returned: 0 in 0.241s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" released by "_copy_volume_from_snapshot" :: held 13.128s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Acquiring lock "cinder-quobyte-538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Deleting offline snapshot 538d4deb-cfd1-4319-bcc5-a9d0cb32e2df of volume a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] snapshot_file for this snap is: volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca30afe-1664-41d8-9103-03f1256ce8d5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:35 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df Nov 03 18:24:35 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:35 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" returned: 0 in 0.355s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:24:35 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb9470a-91ba-45c5-b294-deb3153a482e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:35 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 Nov 03 18:24:35 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:35 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9" returned: 0 in 0.532s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:35 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df Nov 03 18:24:35 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:36 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:36 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df Nov 03 18:24:36 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:36 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9.538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-538d4deb-cfd1-4319-bcc5-a9d0cb32e2df" released by "_delete_snapshot" :: held 1.601s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.336s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.819s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-862610525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080d9f94-2056-4987-90e5-23b1f0e600c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8039c850f740429abaa650079c019a0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:19Z,use_quota=True,user_id='df5e061a745a4149a7f04f0f7fdd34da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Creating volume 080d9f94-2056-4987-90e5-23b1f0e600c4 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:24:36 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:24:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:36 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 1073741824 Nov 03 18:24:36 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:36 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-840bb648-8550-4d2c-9c32-9bbe5a3ceeda tempest-GroupsV314Test-1759744186 None] Create group from source-group-d86e4c74-1a99-40d4-937d-fda601884aef completed successfully. Nov 03 18:24:37 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 1073741824" returned: 0 in 0.470s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:37 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 Nov 03 18:24:37 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Acquiring lock "cinder-quobyte-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:24:37 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.713s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-219173722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ccc8da9-c2df-4919-aa32-20193b23104a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8b1bc244df242148b4cab34fe9fd333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:22Z,use_quota=True,user_id='7200d1ddf1884aa39c71b2750f5b94a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Creating volume 3ccc8da9-c2df-4919-aa32-20193b23104a {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:24:37 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7082cc30-0c49-47ce-b9aa-04c737b1edf5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:37 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a 1073741824 Nov 03 18:24:37 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98980af2-cb68-472c-a9c4-24a1d6ea5ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080d9f94-2056-4987-90e5-23b1f0e600c4', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee1a14d-5ad0-4fe0-9d3d-7314ca20856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:37 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Volume volume-080d9f94-2056-4987-90e5-23b1f0e600c4 (080d9f94-2056-4987-90e5-23b1f0e600c4): created successfully Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee1a14d-5ad0-4fe0-9d3d-7314ca20856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Flow 'volume_create_manager' (1850e8a2-a7b9-432a-97fd-17cb7898da43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ddc18c71-4e24-4d95-a56b-42bb58d6d6d4 tempest-ServerRescueNegativeTestJSON-986653173 None] Created volume successfully. Nov 03 18:24:37 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e Nov 03 18:24:37 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:37 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" returned: 0 in 0.411s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:37 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a 1073741824" returned: 0 in 0.441s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:37 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e Nov 03 18:24:37 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:37 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a Nov 03 18:24:37 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:38 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" returned: 0 in 0.291s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-d9baa0b8-6b2e-4439-82e6-2c20b1598d6e" released by "delete_volume" :: held 0.756s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:24:38 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a" returned: 0 in 0.278s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Attempting download of 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume 3ccc8da9-c2df-4919-aa32-20193b23104a. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Created reservations ['2c5d164c-5654-46f7-8388-18425590f6ea'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a17ee-c8a5-48eb-835b-9ec48f0693b4]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:38 devstack cinder-volume[86841]: WARNING cinder.quota [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1430906729 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1430906729, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:24:38 devstack cinder-volume[86841]: WARNING cinder.quota [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1430906729 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1430906729, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Created reservations ['3c4bdcbe-5836-4102-9ec1-fc91120e61de', 'e968ac48-1b46-4f61-91c7-6ad04d96401f', 'aa2f260f-3423-4022-8cea-ac7d7dd88991', '0212e7bf-8c48-40dd-9ff4-99087050e1a0'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:24:38 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by Nov 03 18:24:38 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:38 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:24:38 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:38 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by" returned: 0 in 0.515s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:38 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:38 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:24:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0328cd04-e26d-474d-9310-5330607c64b1 tempest-GroupsV314Test-1759744186 None] Delete group completed successfully. Nov 03 18:24:38 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by Nov 03 18:24:38 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:39 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by" returned: 1 in 0.428s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_oye3o3by' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c002fd-fe20-49ea-86aa-62c8456858f7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:39 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD Nov 03 18:24:39 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:39 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] 3cc5f1a8-28a8-4446-80b6-6636c7f415bb was qcow2, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:39 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a Nov 03 18:24:39 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Acquiring lock "cinder-quobyte-a89de2c4-f692-4c9b-a892-5306dbe07ab9" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-a89de2c4-f692-4c9b-a892-5306dbe07ab9" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bb495-e58a-49d1-88db-3af9c34204f3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:40 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 Nov 03 18:24:40 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:40 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9" returned: 0 in 0.503s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:40 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9 Nov 03 18:24:40 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:40 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-a89de2c4-f692-4c9b-a892-5306dbe07ab9" returned: 0 in 0.298s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Lock "cinder-quobyte-a89de2c4-f692-4c9b-a892-5306dbe07ab9" released by "delete_volume" :: held 0.897s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:24:40 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Created reservations ['6a0e3765-9d0a-4af2-b466-9c0845cdd289'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Created reservations ['b08c3139-e948-4006-9fb4-ea04c1aae78c', '52c92f6c-5656-483f-92a0-c89112906f06', '68a3f112-3956-4f83-9512-13c92a477ec8', 'e276b186-13e8-45ba-8e41-3d0674258d6a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:41 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:24:41 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:41 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.432s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:41 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:24:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-84512757-c33e-4694-a5fc-47888f8ed6d6 tempest-GroupsV314Test-1759744186 None] Delete group completed successfully. Nov 03 18:24:42 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a" returned: 0 in 2.621s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_r7ttywrxdevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:24:42 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Converted 112.00 MB image at 42.72 MB/s Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:42 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a 1G Nov 03 18:24:42 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:42 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a 1G" returned: 0 in 0.380s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Downloaded image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume 3ccc8da9-c2df-4919-aa32-20193b23104a successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb for user 7200d1ddf1884aa39c71b2750f5b94a7 is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Marking volume 3ccc8da9-c2df-4919-aa32-20193b23104a as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Copying metadata from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb to 3ccc8da9-c2df-4919-aa32-20193b23104a. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Creating volume glance metadata for volume 3ccc8da9-c2df-4919-aa32-20193b23104a backed by image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef4df5c-f058-4dcc-b05c-10de1fc665c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ccc8da9-c2df-4919-aa32-20193b23104a', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cce081-1394-4034-b6fd-410dd44fd54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:42 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Volume volume-3ccc8da9-c2df-4919-aa32-20193b23104a (3ccc8da9-c2df-4919-aa32-20193b23104a): created successfully Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28cce081-1394-4034-b6fd-410dd44fd54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Flow 'volume_create_manager' (3de1b367-fb4e-4cf8-a168-2fb4e5fff096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b538ceae-4baa-4796-a1d5-9e778c16f61e tempest-ServerActionsTestOtherA-2004651196 None] Created volume successfully. Nov 03 18:24:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-cb2da334-3fab-491c-847d-84724c2f045e req-e2f0aef7-2994-495c-b9b1-53ca7018130f tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-cb2da334-3fab-491c-847d-84724c2f045e req-e2f0aef7-2994-495c-b9b1-53ca7018130f tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-cb2da334-3fab-491c-847d-84724c2f045e req-e2f0aef7-2994-495c-b9b1-53ca7018130f tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-cb2da334-3fab-491c-847d-84724c2f045e req-e2f0aef7-2994-495c-b9b1-53ca7018130f tempest-ServerActionsTestOtherA-2004651196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-3ccc8da9-c2df-4919-aa32-20193b23104a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c2d3cc5-f4e0-4521-9798-fd2bf01c768e', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:24:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-cb2da334-3fab-491c-847d-84724c2f045e req-e2f0aef7-2994-495c-b9b1-53ca7018130f tempest-ServerActionsTestOtherA-2004651196 None] attachment_update completed successfully. Nov 03 18:24:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Acquiring lock "cinder-080d9f94-2056-4987-90e5-23b1f0e600c4-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:24:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "cinder-080d9f94-2056-4987-90e5-23b1f0e600c4-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:24:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Acquiring lock "cinder-quobyte-080d9f94-2056-4987-90e5-23b1f0e600c4" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:24:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "cinder-quobyte-080d9f94-2056-4987-90e5-23b1f0e600c4" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:24:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd50d88-193c-4c38-9aaa-b0d3d3a7bfd7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:48 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 Nov 03 18:24:48 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:49 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4" returned: 0 in 0.714s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:49 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4 Nov 03 18:24:49 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:49 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-080d9f94-2056-4987-90e5-23b1f0e600c4" returned: 0 in 0.592s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Flow 'volume_create_manager' (b5cab408-309a-4a29-be72-10c506d064fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4108e77-ef3a-4740-9462-31156822843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "cinder-quobyte-080d9f94-2056-4987-90e5-23b1f0e600c4" released by "delete_volume" :: held 1.417s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4108e77-ef3a-4740-9462-31156822843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-554350762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bd5967-7d30-45be-b981-7cbeba51fc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d7d650d3d43f18a02b324bbdb283b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:50Z,use_quota=True,user_id='912146b9c8b4497b828debc0f8b3778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b516b7-1d1a-4354-8d2a-8db7d5745c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b516b7-1d1a-4354-8d2a-8db7d5745c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6603b901-074d-479f-a5e3-f1fc20f60bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6603b901-074d-479f-a5e3-f1fc20f60bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bd5967-7d30-45be-b981-7cbeba51fc07', 'volume_name': 'volume-97bd5967-7d30-45be-b981-7cbeba51fc07', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25697b1c-65b0-4854-a69c-624174df5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25697b1c-65b0-4854-a69c-624174df5062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f057f426-322f-4cbe-9e79-ec75af049d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Volume 97bd5967-7d30-45be-b981-7cbeba51fc07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bd5967-7d30-45be-b981-7cbeba51fc07', 'volume_size': 1} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-554350762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bd5967-7d30-45be-b981-7cbeba51fc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5d7d650d3d43f18a02b324bbdb283b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:50Z,use_quota=True,user_id='912146b9c8b4497b828debc0f8b3778d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Creating volume 97bd5967-7d30-45be-b981-7cbeba51fc07 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:24:49 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:49 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 1073741824 Nov 03 18:24:49 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:49 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Created reservations ['d3d245f4-0565-46c0-a030-a1d86bcc9643', 'd65c2ba1-5890-45d7-a01f-f8fe6f3ba739', '2d6e2e69-c30c-44cd-adf5-28f62702fe10', 'fc689afd-92ea-43b6-be36-a3fa53244bcc'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:50 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:24:50 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:50 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.310s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:24:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Deleted volume successfully. Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-283e7cef-6dee-4808-8a85-e383c2979f84 tempest-ServerRescueNegativeTestJSON-986653173 None] Lock "cinder-080d9f94-2056-4987-90e5-23b1f0e600c4-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:24:50 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 1073741824" returned: 0 in 0.828s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:50 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 Nov 03 18:24:50 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Flow 'volume_create_manager' (6f06f161-44ea-43a2-b0f8-339c8edc886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003e4a68-1ea7-4697-a954-f3a61cd77057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003e4a68-1ea7-4697-a954-f3a61cd77057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1165571190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88667c3d-02ae-4d31-9d26-7bec558a503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cb4e078d404910bc1d18f9a0e23870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:51Z,use_quota=True,user_id='eb52e8dc9e1348d48cb2addd38312144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0e16cf-af6a-4b06-92db-7712eb253eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0e16cf-af6a-4b06-92db-7712eb253eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fca8a19-08a8-4542-b1f5-8a215dcda047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fca8a19-08a8-4542-b1f5-8a215dcda047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88667c3d-02ae-4d31-9d26-7bec558a503e', 'volume_name': 'volume-88667c3d-02ae-4d31-9d26-7bec558a503e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d5ba21-e1e5-4ccc-b5c9-01e60b53aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d5ba21-e1e5-4ccc-b5c9-01e60b53aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb98bed-238f-4d36-a2f6-751785e33d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Volume 88667c3d-02ae-4d31-9d26-7bec558a503e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88667c3d-02ae-4d31-9d26-7bec558a503e', 'volume_size': 1} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:51 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07" returned: 0 in 0.554s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1165571190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88667c3d-02ae-4d31-9d26-7bec558a503e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41cb4e078d404910bc1d18f9a0e23870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:24:51Z,use_quota=True,user_id='eb52e8dc9e1348d48cb2addd38312144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Creating volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:24:51 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f057f426-322f-4cbe-9e79-ec75af049d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bd5967-7d30-45be-b981-7cbeba51fc07', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b9a404-bbcd-4b2d-b6f0-e42aee9640e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Volume volume-97bd5967-7d30-45be-b981-7cbeba51fc07 (97bd5967-7d30-45be-b981-7cbeba51fc07): created successfully Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b9a404-bbcd-4b2d-b6f0-e42aee9640e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:51 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e 1073741824 Nov 03 18:24:51 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Flow 'volume_create_manager' (b5cab408-309a-4a29-be72-10c506d064fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bce841b8-7bc3-4dc6-89c8-0e57f0d2d586 tempest-AttachVolumeShelveTestJSON-1896634970 None] Created volume successfully. Nov 03 18:24:52 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e 1073741824" returned: 0 in 1.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:52 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e Nov 03 18:24:52 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:53 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e" returned: 0 in 0.499s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb98bed-238f-4d36-a2f6-751785e33d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88667c3d-02ae-4d31-9d26-7bec558a503e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d7079-720b-48f1-aba5-74fc8bd9db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:24:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Volume volume-88667c3d-02ae-4d31-9d26-7bec558a503e (88667c3d-02ae-4d31-9d26-7bec558a503e): created successfully Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6d7079-720b-48f1-aba5-74fc8bd9db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:24:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Flow 'volume_create_manager' (6f06f161-44ea-43a2-b0f8-339c8edc886e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:24:53 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7beb0841-c69b-47f4-920c-2ddce87e6e3f tempest-SnapshotsActionsTest-485238188 None] Created volume successfully. Nov 03 18:24:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Creating offline snapshot e81696ff-33ea-48c1-8fd5-47b7fb190406 of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:24:55 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[491577a5-26c4-47c0-a3f3-30d40d814a24]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:24:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:55 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e Nov 03 18:24:55 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:56 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e" returned: 0 in 0.753s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:56 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 1G Nov 03 18:24:56 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:57 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 1G" returned: 0 in 0.971s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:57 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:24:57 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:57 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.752s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:57 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 is being set with open permissions: ugo+rw Nov 03 18:24:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:58 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:24:58 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:58 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.784s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:58 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info Nov 03 18:24:58 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:59 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info" returned: 0 in 0.488s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:24:59 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info is being set with open permissions: ugo+rw Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:59 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info Nov 03 18:24:59 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:24:59 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:24:59 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:24:59 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Nov 03 18:24:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.info" returned: 0 in 0.691s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.674s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-266980ad-b9b8-493d-9e50-d383aaed5138 tempest-SnapshotsActionsTest-485238188 None] Create snapshot completed successfully Nov 03 18:25:00 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.711s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:00 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:25:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:25:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:25:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Creating offline snapshot 09514827-ad34-4804-a334-37ae9c1886aa of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:25:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f6703-6a07-41dd-8270-78916a92ee5f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:02 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:02 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:03 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 1.100s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:03 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa 1G Nov 03 18:25:03 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:04 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa 1G" returned: 0 in 1.039s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:04 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa Nov 03 18:25:04 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:05 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa" returned: 0 in 0.562s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:05 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa is being set with open permissions: ugo+rw Nov 03 18:25:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:05 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa Nov 03 18:25:05 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:05 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa" returned: 0 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.274s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-888b75b9-b663-45e7-a382-a869047e1984 tempest-SnapshotsActionsTest-485238188 None] Create snapshot completed successfully Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-09514827-ad34-4804-a334-37ae9c1886aa-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-09514827-ad34-4804-a334-37ae9c1886aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-09514827-ad34-4804-a334-37ae9c1886aa" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-09514827-ad34-4804-a334-37ae9c1886aa" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Deleting offline snapshot 09514827-ad34-4804-a334-37ae9c1886aa of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] snapshot_file for this snap is: volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6507f1e9-4d29-4598-9887-8e7e04fcd867]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:07 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa Nov 03 18:25:07 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:08 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa" returned: 0 in 0.864s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0043d3c3-f6f4-425a-96a2-b192d302a0de]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:08 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:08 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:08 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.581s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:08 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa Nov 03 18:25:08 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:09 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa" returned: 0 in 0.436s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:09 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa Nov 03 18:25:09 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:09 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.09514827-ad34-4804-a334-37ae9c1886aa" returned: 0 in 0.482s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-09514827-ad34-4804-a334-37ae9c1886aa" released by "_delete_snapshot" :: held 2.578s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" released by "delete_snapshot" :: held 2.621s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:10 devstack cinder-volume[86841]: WARNING cinder.quota [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:25:10 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Created reservations ['3c9045cd-ed68-40f9-94ad-63eb013f3e68', '9350b2b2-1a25-4943-a71d-36765a0c36fb', 'f8b52764-8d93-4e5f-84de-ff7812c68224', '54c5e4a8-7da2-43df-b493-0742189cd918'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-94e7f9a3-9dd6-48ae-b38d-c6fb505da0dd tempest-ServerActionsTestOtherA-2004651196 None] Terminate volume connection completed successfully. Nov 03 18:25:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-94e7f9a3-9dd6-48ae-b38d-c6fb505da0dd tempest-ServerActionsTestOtherA-2004651196 None] Deleting attachment 1c2d3cc5-f4e0-4521-9798-fd2bf01c768e. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:25:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Delete snapshot completed successfully. Nov 03 18:25:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fa5babf2-304a-4482-aef8-3ed928454332 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-09514827-ad34-4804-a334-37ae9c1886aa-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Creating offline snapshot 62ef81ba-e21f-4fb5-a2d5-7ff73f49496e of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea105f90-6ef6-4df1-89ea-7a3d75b4f183]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:11 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:11 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-67b0fc71-6686-4936-92db-d5f22f1b580c req-153fb7c7-239f-4dff-be10-a9b276068d93 tempest-AttachVolumeShelveTestJSON-1896634970 None] No connector for attachment 27a98562-4872-47fa-9cce-d1ad20fd41ce; skipping storage backend terminate_connection call. {{(pid=86841) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-67b0fc71-6686-4936-92db-d5f22f1b580c req-153fb7c7-239f-4dff-be10-a9b276068d93 tempest-AttachVolumeShelveTestJSON-1896634970 None] Deleting attachment 27a98562-4872-47fa-9cce-d1ad20fd41ce. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:25:11 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.513s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:11 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e 1G Nov 03 18:25:11 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-913fbf6a-3e75-43b6-bd4b-415391c379cc tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:12 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e 1G" returned: 0 in 0.705s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:12 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e Nov 03 18:25:12 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:12 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:12 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e is being set with open permissions: ugo+rw Nov 03 18:25:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:12 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e Nov 03 18:25:12 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:13 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" returned: 0 in 0.309s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-913fbf6a-3e75-43b6-bd4b-415391c379cc tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.799s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-913fbf6a-3e75-43b6-bd4b-415391c379cc tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-40da84d9-fc67-47f9-855f-ac848f36105d tempest-SnapshotsActionsTest-485238188 None] Create snapshot completed successfully Nov 03 18:25:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-913fbf6a-3e75-43b6-bd4b-415391c379cc tempest-ServerActionsTestOtherA-2004651196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-3ccc8da9-c2df-4919-aa32-20193b23104a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '609acdb0-4156-4172-aa83-3c696a3df19e', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:25:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-a6fc3182-4df6-4827-961c-e9f78ec04578 req-913fbf6a-3e75-43b6-bd4b-415391c379cc tempest-ServerActionsTestOtherA-2004651196 None] attachment_update completed successfully. Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-62ef81ba-e21f-4fb5-a2d5-7ff73f49496e-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-62ef81ba-e21f-4fb5-a2d5-7ff73f49496e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Deleting offline snapshot 62ef81ba-e21f-4fb5-a2d5-7ff73f49496e of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] snapshot_file for this snap is: volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[954aeecf-67e9-439b-9fb1-ed45a1bcb3bf]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:14 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e Nov 03 18:25:14 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:15 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" returned: 0 in 0.576s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a1bad0-be9d-461f-b4d9-9cef165a3f73]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:15 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:15 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:15 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.520s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:15 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e Nov 03 18:25:15 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:16 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" returned: 0 in 0.743s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:16 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e Nov 03 18:25:16 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:17 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" returned: 0 in 0.428s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-62ef81ba-e21f-4fb5-a2d5-7ff73f49496e" released by "_delete_snapshot" :: held 2.472s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" released by "delete_snapshot" :: held 2.514s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:17 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Created reservations ['74b8068b-912e-45a6-9e37-eaf6eeb65813', '63f1c917-7458-43de-b8d4-91ff452b09b7', 'fef3003e-2d19-4b87-8acc-a2b4d99d3718', '29b77c93-6cf7-415d-a504-df0853e47c0b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Delete snapshot completed successfully. Nov 03 18:25:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b7a77cd2-5121-41f4-b9d5-42a0c5caedc4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-62ef81ba-e21f-4fb5-a2d5-7ff73f49496e-delete_snapshot" released by "delete_snapshot" :: held 2.754s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Creating offline snapshot 99f836f9-9422-4e2e-825e-c978b45d6af7 of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:25:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d680eef-0ac9-4319-aac8-0d6ad0106af3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:19 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:19 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:20 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.914s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:20 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 1G Nov 03 18:25:20 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:20 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 1G" returned: 0 in 0.743s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:20 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 Nov 03 18:25:20 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:21 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7" returned: 0 in 0.499s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:21 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 is being set with open permissions: ugo+rw Nov 03 18:25:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:21 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 Nov 03 18:25:21 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:21 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7" returned: 0 in 0.594s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e274b833-a975-41fb-93b9-803ee7d01f31 tempest-SnapshotsActionsTest-485238188 None] Create snapshot completed successfully Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-99f836f9-9422-4e2e-825e-c978b45d6af7-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-99f836f9-9422-4e2e-825e-c978b45d6af7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-99f836f9-9422-4e2e-825e-c978b45d6af7" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-99f836f9-9422-4e2e-825e-c978b45d6af7" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Deleting offline snapshot 99f836f9-9422-4e2e-825e-c978b45d6af7 of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] snapshot_file for this snap is: volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca24f0c-1cde-47da-b32c-87e7741eb309]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:23 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 Nov 03 18:25:23 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:24 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7" returned: 0 in 0.622s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d718fff-db8f-4060-aa3d-03075737c8ea]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:24 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:24 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:24 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.488s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:24 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 Nov 03 18:25:24 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:25 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7" returned: 0 in 0.961s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:25 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7 Nov 03 18:25:25 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:26 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.99f836f9-9422-4e2e-825e-c978b45d6af7" returned: 0 in 0.504s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-99f836f9-9422-4e2e-825e-c978b45d6af7" released by "_delete_snapshot" :: held 2.831s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" released by "delete_snapshot" :: held 2.880s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:26 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Created reservations ['54b8670f-0241-4390-944d-7f81e6162ced', '6943ba70-8825-4711-bd4d-dee8992e43c2', 'bf93154f-aae3-44c3-ac7c-700b30c070f5', '84162aef-c453-4b9c-90ab-1bd5f51725cd'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Delete snapshot completed successfully. Nov 03 18:25:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7803cb7b-8b37-4e39-b1a0-1c4c409847e4 tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-99f836f9-9422-4e2e-825e-c978b45d6af7-delete_snapshot" released by "delete_snapshot" :: held 3.179s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Creating offline snapshot 3c5aeebf-6960-46df-a155-d4d5b933b7e0 of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:25:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1a30ef-3430-40a4-8e80-9ecd6b6403ab]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:27 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:27 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:28 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.653s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:28 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 1G Nov 03 18:25:28 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:28 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 1G" returned: 0 in 0.681s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:28 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 Nov 03 18:25:28 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-38a59f80-91a5-4029-af74-f425d10b35d2 tempest-GroupsTest-1621630943 None] Group tempest-Group1-1795369673: creating Nov 03 18:25:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-38a59f80-91a5-4029-af74-f425d10b35d2 tempest-GroupsTest-1621630943 None] Group tempest-Group1-1795369673: created successfully Nov 03 18:25:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-38a59f80-91a5-4029-af74-f425d10b35d2 tempest-GroupsTest-1621630943 None] Create group completed successfully. Nov 03 18:25:29 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0" returned: 0 in 0.375s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:29 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 is being set with open permissions: ugo+rw Nov 03 18:25:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:29 devstack sudo[92772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 Nov 03 18:25:29 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:29 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-098e69c3-8b7f-4020-a1ac-9f7ce83e3155 tempest-SnapshotsActionsTest-485238188 None] Create snapshot completed successfully Nov 03 18:25:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-557e9d29-0067-4ef0-8356-ac90b02b913c tempest-GroupsTest-1621630943 None] Group tempest-Group2-233154583: creating Nov 03 18:25:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-557e9d29-0067-4ef0-8356-ac90b02b913c tempest-GroupsTest-1621630943 None] Group tempest-Group2-233154583: created successfully Nov 03 18:25:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-557e9d29-0067-4ef0-8356-ac90b02b913c tempest-GroupsTest-1621630943 None] Create group completed successfully. Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-3c5aeebf-6960-46df-a155-d4d5b933b7e0-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-3c5aeebf-6960-46df-a155-d4d5b933b7e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Acquiring lock "cinder-quobyte-3c5aeebf-6960-46df-a155-d4d5b933b7e0" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-3c5aeebf-6960-46df-a155-d4d5b933b7e0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Deleting offline snapshot 3c5aeebf-6960-46df-a155-d4d5b933b7e0 of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] snapshot_file for this snap is: volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50211f6-a2bf-42dd-9611-8b1ea5a5439c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:30 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 Nov 03 18:25:30 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:31 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0" returned: 0 in 0.387s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eb2ecb-2ff0-4d9f-b8d5-8901e764eb5a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:31 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:31 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:31 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.393s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:31 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 Nov 03 18:25:31 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:32 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0" returned: 0 in 0.471s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:32 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0 Nov 03 18:25:32 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Flow 'volume_create_manager' (3441bc31-2d09-4090-bc2c-d0ace2af4298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb60ef57-7430-4541-9399-52542342ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:32 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.3c5aeebf-6960-46df-a155-d4d5b933b7e0" returned: 0 in 0.435s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb60ef57-7430-4541-9399-52542342ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1191643124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b197d1ca-1df1-475d-93d9-70f54091e31c,host='devstack@QuobyteHD#QuobyteHD',id=fb7884af-837c-4511-9254-15785b59228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c627b6f56f004702b37f826ae04f66ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:32Z,use_quota=True,user_id='4752d8b652d749a4985841a3dd0552ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc8f005-cbec-4ff8-94b6-c746f48831fe),volume_type_id=7fc8f005-cbec-4ff8-94b6-c746f48831fe)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da54c898-dfe5-4915-9c99-86c76f5be8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da54c898-dfe5-4915-9c99-86c76f5be8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa9cfd1-9f08-4484-9f6b-215f07f26de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa9cfd1-9f08-4484-9f6b-215f07f26de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7884af-837c-4511-9254-15785b59228b', 'volume_name': 'volume-fb7884af-837c-4511-9254-15785b59228b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b9f29-9b4f-440a-b76a-88ffde7388f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b9f29-9b4f-440a-b76a-88ffde7388f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7b0dc1-d397-4bd7-918d-d633707142a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:32 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Volume fb7884af-837c-4511-9254-15785b59228b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7884af-837c-4511-9254-15785b59228b', 'volume_size': 1} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b197d1ca-1df1-475d-93d9-70f54091e31c,created_at=2026-11-03T17:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1191643124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b197d1ca-1df1-475d-93d9-70f54091e31c,host='devstack@QuobyteHD#QuobyteHD',id=fb7884af-837c-4511-9254-15785b59228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c627b6f56f004702b37f826ae04f66ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:32Z,use_quota=True,user_id='4752d8b652d749a4985841a3dd0552ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fc8f005-cbec-4ff8-94b6-c746f48831fe),volume_type_id=7fc8f005-cbec-4ff8-94b6-c746f48831fe)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Creating volume fb7884af-837c-4511-9254-15785b59228b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:25:32 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-3c5aeebf-6960-46df-a155-d4d5b933b7e0" released by "_delete_snapshot" :: held 1.860s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" released by "delete_snapshot" :: held 1.887s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:32 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b 1073741824 Nov 03 18:25:32 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Created reservations ['58626716-7b5c-490d-9e4c-9d7098b48bb0', '6bc3d304-1160-4127-b210-590f32c37b13', '9552cf3a-bf98-4112-87ca-fa219018ea44', '1637e6dd-86fc-495c-a9be-795617bd186f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Delete snapshot completed successfully. Nov 03 18:25:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-19f425d4-251e-4af8-9152-5e42fe3ca7af tempest-SnapshotsActionsTest-1570646587 None] Lock "cinder-3c5aeebf-6960-46df-a155-d4d5b933b7e0-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:33 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b 1073741824" returned: 0 in 0.634s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:33 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b Nov 03 18:25:33 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:33 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b" returned: 0 in 0.317s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f7b0dc1-d397-4bd7-918d-d633707142a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7884af-837c-4511-9254-15785b59228b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cce0c1b-af96-4a7d-bdf0-fb2f4ea961f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:33 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Volume volume-fb7884af-837c-4511-9254-15785b59228b (fb7884af-837c-4511-9254-15785b59228b): created successfully Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cce0c1b-af96-4a7d-bdf0-fb2f4ea961f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Flow 'volume_create_manager' (3441bc31-2d09-4090-bc2c-d0ace2af4298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1c0dfa50-a485-4200-a8a0-3630226b2a16 tempest-GroupsTest-1621630943 None] Created volume successfully. Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "cinder-e81696ff-33ea-48c1-8fd5-47b7fb190406-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-e81696ff-33ea-48c1-8fd5-47b7fb190406-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "cinder-quobyte-e81696ff-33ea-48c1-8fd5-47b7fb190406" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-quobyte-e81696ff-33ea-48c1-8fd5-47b7fb190406" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Deleting offline snapshot e81696ff-33ea-48c1-8fd5-47b7fb190406 of volume 88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] snapshot_file for this snap is: volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[928f75a5-a5d3-4be2-a7fc-70a19c35f88e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:34 devstack sudo[92868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:34 devstack sudo[92868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:34 devstack sudo[92868]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.470s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88667c3d-02ae-4d31-9d26-7bec558a503e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:25:34 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d45749-21fb-41e5-8dcb-70e71a07d7f9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:34 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e Nov 03 18:25:34 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:34 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e" returned: 0 in 0.403s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:34 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:34 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:35 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.398s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:35 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406 Nov 03 18:25:35 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:35 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e.e81696ff-33ea-48c1-8fd5-47b7fb190406" returned: 0 in 0.264s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=92,cinder:SELECT=87,cinder:INSERT=18,cinder:DELETE=5 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=70,cinder:SELECT=90,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-quobyte-e81696ff-33ea-48c1-8fd5-47b7fb190406" released by "_delete_snapshot" :: held 1.692s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" released by "delete_snapshot" :: held 1.746s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Created reservations ['8aab7ce1-8548-41a3-9d9b-8b05a86f4d32', 'a0aea0c7-a38a-4945-8114-e47882175d01', 'a26fa27c-fcc7-4899-bf79-59d82523ca3b', '1be4a5da-4ef4-4498-8c58-3a7050837454'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Acquiring lock "cinder-quobyte-fb7884af-837c-4511-9254-15785b59228b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Lock "cinder-quobyte-fb7884af-837c-4511-9254-15785b59228b" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da4f13e-d458-434b-9a9a-410d46cd4b67]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Delete snapshot completed successfully. Nov 03 18:25:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3e7ca3ef-fd82-45fb-8d99-b454551f690c tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-e81696ff-33ea-48c1-8fd5-47b7fb190406-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:35 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b Nov 03 18:25:35 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "cinder-88667c3d-02ae-4d31-9d26-7bec558a503e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-88667c3d-02ae-4d31-9d26-7bec558a503e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:36 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b" returned: 0 in 0.442s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[467ba59f-8f9b-48cc-8ba8-8855245e13ef]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:36 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b Nov 03 18:25:36 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:36 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e Nov 03 18:25:36 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:36 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-fb7884af-837c-4511-9254-15785b59228b" returned: 0 in 0.250s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Lock "cinder-quobyte-fb7884af-837c-4511-9254-15785b59228b" released by "delete_volume" :: held 0.758s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Created reservations ['f4f8e625-ef5d-4356-ab7a-327ccfce2c78'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:36 devstack cinder-volume[86841]: WARNING cinder.quota [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1713729366 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1713729366, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:25:36 devstack cinder-volume[86841]: WARNING cinder.quota [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1713729366 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1713729366, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Created reservations ['f7c48235-4bb9-4588-b17c-04e0b9b31f65', 'f653c263-65ec-41af-ab18-eee56b9aa7f5', '127ab760-9242-4072-8458-fca200f10af7', '12952d4e-17b7-40ae-b1b5-96c54048395b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:36 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e" returned: 0 in 0.406s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:36 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e Nov 03 18:25:36 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:36 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:36 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:36 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88667c3d-02ae-4d31-9d26-7bec558a503e" returned: 0 in 0.303s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-quobyte-88667c3d-02ae-4d31-9d26-7bec558a503e" released by "delete_volume" :: held 0.801s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:37 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.321s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Created reservations ['bee175e0-0db4-4068-9bf5-bc84efba4a58', 'd124041d-eb6a-4564-8caa-926db14d7c58', '0af9f05f-3538-4885-b82e-0a3354a5c065', '68a528b3-7e18-4999-89da-eae6b68275b7'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8d48942a-b229-4f93-9a5f-8b20e2da69be tempest-GroupsTest-1621630943 None] Delete group completed successfully. Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Created reservations ['b826bdf5-cb31-4bd9-848a-63c435e60e80'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:37 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:37 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:37 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:37 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:37 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.353s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Deleted volume successfully. Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-80ab7475-cf6f-44d4-942f-b0239a187e2e tempest-SnapshotsActionsTest-485238188 None] Lock "cinder-88667c3d-02ae-4d31-9d26-7bec558a503e-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:37 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.335s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8b1774d5-83a5-4f6d-9a01-69e60c24d7be tempest-GroupsTest-1621630943 None] Delete group completed successfully. Nov 03 18:25:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-37d3c890-8599-45ce-8d88-591ad743cb35 tempest-GroupsTest-1621630943 None] Group tempest-GroupsTest-Group-756981774: creating Nov 03 18:25:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-37d3c890-8599-45ce-8d88-591ad743cb35 tempest-GroupsTest-1621630943 None] Group tempest-GroupsTest-Group-756981774: created successfully Nov 03 18:25:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-37d3c890-8599-45ce-8d88-591ad743cb35 tempest-GroupsTest-1621630943 None] Create group completed successfully. Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Flow 'volume_create_manager' (a22e7b61-3558-4f45-814e-c1ba3e86742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b5e20f-ea3a-4e4e-a362-cf7b54e5536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b5e20f-ea3a-4e4e-a362-cf7b54e5536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-378781706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ced5b2d6-9799-42c5-935f-f03ecd99ffba,host='devstack@QuobyteHD#QuobyteHD',id=0af21d19-1741-496a-9543-8a3b51900c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c627b6f56f004702b37f826ae04f66ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:40Z,use_quota=True,user_id='4752d8b652d749a4985841a3dd0552ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfe14ca7-2b42-48d1-bf48-14b1d992fe5a),volume_type_id=dfe14ca7-2b42-48d1-bf48-14b1d992fe5a)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5ab488-0884-495b-b23e-f7593f2c1002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5ab488-0884-495b-b23e-f7593f2c1002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f218d70-50ca-411a-a48b-0ec6e2e19f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f218d70-50ca-411a-a48b-0ec6e2e19f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af21d19-1741-496a-9543-8a3b51900c61', 'volume_name': 'volume-0af21d19-1741-496a-9543-8a3b51900c61', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98200d7-23aa-4b6e-8dc5-58c4776ffb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98200d7-23aa-4b6e-8dc5-58c4776ffb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f3cd54-663e-44b3-bcd8-b50cff53631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Volume 0af21d19-1741-496a-9543-8a3b51900c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af21d19-1741-496a-9543-8a3b51900c61', 'volume_size': 1} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ced5b2d6-9799-42c5-935f-f03ecd99ffba,created_at=2026-11-03T17:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-378781706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ced5b2d6-9799-42c5-935f-f03ecd99ffba,host='devstack@QuobyteHD#QuobyteHD',id=0af21d19-1741-496a-9543-8a3b51900c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c627b6f56f004702b37f826ae04f66ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:40Z,use_quota=True,user_id='4752d8b652d749a4985841a3dd0552ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfe14ca7-2b42-48d1-bf48-14b1d992fe5a),volume_type_id=dfe14ca7-2b42-48d1-bf48-14b1d992fe5a)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Creating volume 0af21d19-1741-496a-9543-8a3b51900c61 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:25:40 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:25:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:40 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 1073741824 Nov 03 18:25:40 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:41 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 1073741824" returned: 0 in 0.516s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:41 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 Nov 03 18:25:41 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:41 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61" returned: 0 in 0.269s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f3cd54-663e-44b3-bcd8-b50cff53631c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af21d19-1741-496a-9543-8a3b51900c61', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29a1a12-60e5-40e6-8270-d8320898903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Volume volume-0af21d19-1741-496a-9543-8a3b51900c61 (0af21d19-1741-496a-9543-8a3b51900c61): created successfully Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29a1a12-60e5-40e6-8270-d8320898903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Flow 'volume_create_manager' (a22e7b61-3558-4f45-814e-c1ba3e86742c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ab90014a-fae4-4615-81c5-91f3da88dac9 tempest-GroupsTest-1621630943 None] Created volume successfully. Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Flow 'volume_create_manager' (4ce1227d-9960-4975-aa7f-68cab0755e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3827f51-c913-4858-a72c-ec7b1484c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3827f51-c913-4858-a72c-ec7b1484c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-984665405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ced5b2d6-9799-42c5-935f-f03ecd99ffba,host='devstack@QuobyteHD#QuobyteHD',id=6bc879ac-a49f-4268-b55f-8e8697fefee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c627b6f56f004702b37f826ae04f66ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:42Z,use_quota=True,user_id='4752d8b652d749a4985841a3dd0552ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfe14ca7-2b42-48d1-bf48-14b1d992fe5a),volume_type_id=dfe14ca7-2b42-48d1-bf48-14b1d992fe5a)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619f9460-36b8-47b6-ba88-e53eb212be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619f9460-36b8-47b6-ba88-e53eb212be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f7a7d6-8a6a-438e-a6ff-0edad36eb671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6f7a7d6-8a6a-438e-a6ff-0edad36eb671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc879ac-a49f-4268-b55f-8e8697fefee3', 'volume_name': 'volume-6bc879ac-a49f-4268-b55f-8e8697fefee3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c97964-5a97-40b9-a455-71f016feb7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c97964-5a97-40b9-a455-71f016feb7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e96a70-d4d5-46c5-acf9-7435753ec497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:42 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Volume 6bc879ac-a49f-4268-b55f-8e8697fefee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc879ac-a49f-4268-b55f-8e8697fefee3', 'volume_size': 1} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ced5b2d6-9799-42c5-935f-f03ecd99ffba,created_at=2026-11-03T17:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-984665405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ced5b2d6-9799-42c5-935f-f03ecd99ffba,host='devstack@QuobyteHD#QuobyteHD',id=6bc879ac-a49f-4268-b55f-8e8697fefee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c627b6f56f004702b37f826ae04f66ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:42Z,use_quota=True,user_id='4752d8b652d749a4985841a3dd0552ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfe14ca7-2b42-48d1-bf48-14b1d992fe5a),volume_type_id=dfe14ca7-2b42-48d1-bf48-14b1d992fe5a)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Creating volume 6bc879ac-a49f-4268-b55f-8e8697fefee3 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:25:42 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:25:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:42 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 1073741824 Nov 03 18:25:42 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:43 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 1073741824" returned: 0 in 0.535s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:43 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 Nov 03 18:25:43 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:43 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3" returned: 0 in 0.278s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e96a70-d4d5-46c5-acf9-7435753ec497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc879ac-a49f-4268-b55f-8e8697fefee3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932bd800-dbef-4e94-b258-1d368920ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:43 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Volume volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 (6bc879ac-a49f-4268-b55f-8e8697fefee3): created successfully Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932bd800-dbef-4e94-b258-1d368920ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Flow 'volume_create_manager' (4ce1227d-9960-4975-aa7f-68cab0755e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:43 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1e2c7edf-6f16-4eab-b78c-5f685a524e72 tempest-GroupsTest-1621630943 None] Created volume successfully. Nov 03 18:25:43 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1ac48e30-c2c2-4a06-a648-6d9bf9d7fe65 tempest-GroupsTest-1621630943 None] Update group completed successfully. Nov 03 18:25:45 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-5c42ae7b-147d-48bb-aa16-72cfb51cea40 tempest-GroupsTest-1621630943 None] Update group completed successfully. Nov 03 18:25:45 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-90b80c04-7b56-4e4b-98ee-f8f3133aa628 tempest-ServerActionsTestOtherA-2004651196 None] Terminate volume connection completed successfully. Nov 03 18:25:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-90b80c04-7b56-4e4b-98ee-f8f3133aa628 tempest-ServerActionsTestOtherA-2004651196 None] Deleting attachment 609acdb0-4156-4172-aa83-3c696a3df19e. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "cinder-3ccc8da9-c2df-4919-aa32-20193b23104a-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-3ccc8da9-c2df-4919-aa32-20193b23104a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "cinder-quobyte-3ccc8da9-c2df-4919-aa32-20193b23104a" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-quobyte-3ccc8da9-c2df-4919-aa32-20193b23104a" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6381ddc-c083-43c9-9a1f-07b89665fed4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:46 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a Nov 03 18:25:46 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:46 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a" returned: 0 in 0.555s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:46 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a Nov 03 18:25:46 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "cinder-739e32e3-c5d8-4160-b342-498492463fd1-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:47 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3ccc8da9-c2df-4919-aa32-20193b23104a" returned: 0 in 0.419s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-739e32e3-c5d8-4160-b342-498492463fd1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-quobyte-3ccc8da9-c2df-4919-aa32-20193b23104a" released by "delete_volume" :: held 1.075s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "cinder-quobyte-739e32e3-c5d8-4160-b342-498492463fd1" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-quobyte-739e32e3-c5d8-4160-b342-498492463fd1" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d44f8-0096-4683-8228-4722917e0af1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.quota [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Created reservations ['29da4c65-ba8f-47a1-949c-236bbc87337d', '7fce22fe-e535-4d36-a38e-12e5175ec6aa', '05e5ee3c-1011-4c81-a8c6-7d0a5604adc9', '7716b75e-962b-4196-9d51-827935152440'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Acquiring lock "cinder-quobyte-0af21d19-1741-496a-9543-8a3b51900c61" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Lock "cinder-quobyte-0af21d19-1741-496a-9543-8a3b51900c61" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd31bb8-f868-4ddb-bbaf-7e504bbeb18d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:47 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 Nov 03 18:25:47 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:47 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:47 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:47 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 Nov 03 18:25:47 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:47 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1" returned: 0 in 0.487s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:47 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1 Nov 03 18:25:47 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:47 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.manager [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Deleted volume successfully. Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-37c9e141-6c4b-4927-9430-fd0c0ab47de8 req-64d01c92-87d6-4838-a3ad-77664405dc09 tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-3ccc8da9-c2df-4919-aa32-20193b23104a-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:47 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61" returned: 0 in 0.498s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:47 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61 Nov 03 18:25:47 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:48 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-739e32e3-c5d8-4160-b342-498492463fd1" returned: 0 in 0.302s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-quobyte-739e32e3-c5d8-4160-b342-498492463fd1" released by "delete_volume" :: held 0.857s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Created reservations ['cb09ee3f-4579-4f86-b78a-db6a39aa8cef', '5026bbb6-059b-4d46-b49d-aa6018845577', '4cec744b-a8c4-453c-93fd-2e868de84687', '020ce664-9926-49ce-9cab-912e1a74c3dd'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:48 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0af21d19-1741-496a-9543-8a3b51900c61" returned: 0 in 0.294s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Lock "cinder-quobyte-0af21d19-1741-496a-9543-8a3b51900c61" released by "delete_volume" :: held 0.874s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Acquiring lock "cinder-quobyte-6bc879ac-a49f-4268-b55f-8e8697fefee3" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Lock "cinder-quobyte-6bc879ac-a49f-4268-b55f-8e8697fefee3" acquired by "delete_volume" :: waited 0.046s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:48 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:48 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95168d0-3e1c-4dfb-ab65-99809e48a498]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:48 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 Nov 03 18:25:48 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:48 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.420s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Deleted volume successfully. Nov 03 18:25:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4afd94fe-3076-43ab-88e5-f8ef5a0e680b tempest-ServerActionsTestOtherA-2004651196 None] Lock "cinder-739e32e3-c5d8-4160-b342-498492463fd1-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:49 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3" returned: 0 in 0.863s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:49 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3 Nov 03 18:25:49 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:49 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6bc879ac-a49f-4268-b55f-8e8697fefee3" returned: 0 in 0.521s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Lock "cinder-quobyte-6bc879ac-a49f-4268-b55f-8e8697fefee3" released by "delete_volume" :: held 1.458s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:49 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Created reservations ['c9b2519b-11e1-4447-a10e-87d4264cdfa0'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:49 devstack cinder-volume[86841]: WARNING cinder.quota [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-545610269 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-545610269, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:25:49 devstack cinder-volume[86841]: WARNING cinder.quota [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-545610269 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-545610269, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Created reservations ['68c5c8a5-ec6a-452a-98dc-5024bbaeee6d', 'e0352b0e-bbc5-473e-b350-edf4c3672652', 'f70dbdbf-fbdd-40d4-9430-da792adc15da', '4da0366b-c236-4aca-908c-d976edd63130'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Created reservations ['5a9109f2-800d-4717-a06a-49290d87ec09', 'a5f8ad59-d7c0-46c6-b475-7db649e3a631', 'e0e3e2e6-6b81-4af8-b476-b2405395766e', '3ebdb39e-8104-4041-b926-1e0144593fc6'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:50 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:50 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:50 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.319s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:50 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7ea93164-b301-4ada-93e2-6fc8b978f14a tempest-GroupsTest-1621630943 None] Delete group completed successfully. Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Flow 'volume_create_manager' (4401dad9-4a8f-4f29-9383-864654b2a028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c53a8a-6c30-4f26-8601-e59beebd673c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c53a8a-6c30-4f26-8601-e59beebd673c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1905579788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d310cbdc-8830-4573-823c-683eb35ea06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b3e1e4ea034a3f982c690cc0215048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:53Z,use_quota=True,user_id='151c3940c39f415ea2cce5e21ac39eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b07b1ea-6de9-447d-9bec-9da4f6c81e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b07b1ea-6de9-447d-9bec-9da4f6c81e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9023d5-31a7-4ecb-a7fd-4e50caff0141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9023d5-31a7-4ecb-a7fd-4e50caff0141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd310cbdc-8830-4573-823c-683eb35ea06d', 'volume_name': 'volume-d310cbdc-8830-4573-823c-683eb35ea06d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d6c473-09dd-4229-934d-407e214251f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d6c473-09dd-4229-934d-407e214251f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69100d6d-0f45-4595-99b6-5017516e4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Volume d310cbdc-8830-4573-823c-683eb35ea06d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d310cbdc-8830-4573-823c-683eb35ea06d', 'volume_size': 1} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1905579788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d310cbdc-8830-4573-823c-683eb35ea06d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b3e1e4ea034a3f982c690cc0215048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:25:53Z,use_quota=True,user_id='151c3940c39f415ea2cce5e21ac39eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Creating volume d310cbdc-8830-4573-823c-683eb35ea06d {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:25:53 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:53 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d 1073741824 Nov 03 18:25:53 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:53 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d 1073741824" returned: 0 in 0.565s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:53 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d Nov 03 18:25:53 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:54 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69100d6d-0f45-4595-99b6-5017516e4c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d310cbdc-8830-4573-823c-683eb35ea06d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702dfba3-7901-4a5b-9053-99b9a382f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:25:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Volume volume-d310cbdc-8830-4573-823c-683eb35ea06d (d310cbdc-8830-4573-823c-683eb35ea06d): created successfully Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702dfba3-7901-4a5b-9053-99b9a382f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:25:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Flow 'volume_create_manager' (4401dad9-4a8f-4f29-9383-864654b2a028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:25:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-65f1e87b-29a4-45c7-8a00-9d8d2f4a9283 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Created volume successfully. Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Acquiring lock "cinder-97bd5967-7d30-45be-b981-7cbeba51fc07-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "cinder-97bd5967-7d30-45be-b981-7cbeba51fc07-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Acquiring lock "cinder-quobyte-97bd5967-7d30-45be-b981-7cbeba51fc07" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "cinder-quobyte-97bd5967-7d30-45be-b981-7cbeba51fc07" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[98567fc5-2a11-454a-9209-be007a0b076f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:56 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 Nov 03 18:25:56 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Acquiring lock "cinder-d310cbdc-8830-4573-823c-683eb35ea06d-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "cinder-d310cbdc-8830-4573-823c-683eb35ea06d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Acquiring lock "cinder-quobyte-d310cbdc-8830-4573-823c-683eb35ea06d" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "cinder-quobyte-d310cbdc-8830-4573-823c-683eb35ea06d" acquired by "delete_volume" :: waited 0.043s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c32b3-9f1b-4ec7-b165-41d2e316b448]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:56 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07" returned: 0 in 0.562s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:57 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07 Nov 03 18:25:57 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:57 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d Nov 03 18:25:57 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:57 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-97bd5967-7d30-45be-b981-7cbeba51fc07" returned: 0 in 0.287s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "cinder-quobyte-97bd5967-7d30-45be-b981-7cbeba51fc07" released by "delete_volume" :: held 0.912s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Created reservations ['30709132-26d1-4278-ba67-a21d7965c1e1', '582e0fe7-7e03-4727-9088-f0e84990d5ae', '4da8ca36-7355-4eb4-8214-22edb0994ec4', 'c7b312e7-f9e2-4136-b2ea-f8fc249f1ca6'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:57 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d" returned: 0 in 0.436s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:57 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d Nov 03 18:25:57 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:57 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:57 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:57 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d310cbdc-8830-4573-823c-683eb35ea06d" returned: 0 in 0.304s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "cinder-quobyte-d310cbdc-8830-4573-823c-683eb35ea06d" released by "delete_volume" :: held 0.812s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Created reservations ['8856c012-5050-4647-8996-7539b6866dce', 'ff2dc1da-3bfd-4ac3-abcc-537d3da72348', '76c77433-a066-465b-8a41-57d29b9a7202', '696f5fc0-57f7-46df-b235-a5968bb78fc2'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:25:57 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.318s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Deleted volume successfully. Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d6df4506-52de-4855-9269-e78654d26f73 tempest-AttachVolumeShelveTestJSON-1896634970 None] Lock "cinder-97bd5967-7d30-45be-b981-7cbeba51fc07-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:57 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:57 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:58 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:58 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Deleted volume successfully. Nov 03 18:25:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-296deffd-bcb6-41b7-a2d3-9269d991d806 tempest-VolumeQuotasNegativeTestJSON-2027464311 None] Lock "cinder-d310cbdc-8830-4573-823c-683eb35ea06d-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:25:59 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:25:59 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:25:59 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.360s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:25:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:26:07 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=61,cinder:INSERT=24,cinder:UPDATE=88,cinder:DELETE=4 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:26:08 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=76,cinder:INSERT=18,cinder:UPDATE=90,cinder:DELETE=4 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Flow 'volume_create_manager' (d59ed158-0d6c-4fd1-b689-9c71ec19ef93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070cf00a-f69a-435c-be3f-7e591a0199c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070cf00a-f69a-435c-be3f-7e591a0199c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1959841030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a81cf6-c56c-46e1-90e6-b5449fe90c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a0f6883424a5aa65ad1bf270c2bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:24Z,use_quota=True,user_id='8f5271b318b74adf9c170a0967df8819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a379e3d-fad2-40bf-878b-5111c449e00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a379e3d-fad2-40bf-878b-5111c449e00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2de2f3-1eba-41c5-90ad-c18e88a1f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2de2f3-1eba-41c5-90ad-c18e88a1f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a81cf6-c56c-46e1-90e6-b5449fe90c81', 'volume_name': 'volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9eeaf26-b657-49ef-9bc6-308379f5238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9eeaf26-b657-49ef-9bc6-308379f5238d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a87c1e-8a4a-4c10-a138-641768fce895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:23 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Volume 58a81cf6-c56c-46e1-90e6-b5449fe90c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81', 'volume_size': 1} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1959841030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a81cf6-c56c-46e1-90e6-b5449fe90c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a0f6883424a5aa65ad1bf270c2bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:24Z,use_quota=True,user_id='8f5271b318b74adf9c170a0967df8819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Creating volume 58a81cf6-c56c-46e1-90e6-b5449fe90c81 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:23 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:24 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 1073741824 Nov 03 18:26:24 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:24 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 1073741824" returned: 0 in 0.886s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:24 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 Nov 03 18:26:24 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:25 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81" returned: 0 in 0.581s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a87c1e-8a4a-4c10-a138-641768fce895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7c17da-c564-4542-9bb5-443e325a3219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:25 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Volume volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 (58a81cf6-c56c-46e1-90e6-b5449fe90c81): created successfully Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7c17da-c564-4542-9bb5-443e325a3219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Flow 'volume_create_manager' (d59ed158-0d6c-4fd1-b689-9c71ec19ef93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-894b19b9-00ea-428d-8ce5-438da38bf07e tempest-VolumeQuotasAdminTestJSON-167932244 None] Created volume successfully. Nov 03 18:26:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "cinder-58a81cf6-c56c-46e1-90e6-b5449fe90c81-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "cinder-58a81cf6-c56c-46e1-90e6-b5449fe90c81-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "cinder-quobyte-58a81cf6-c56c-46e1-90e6-b5449fe90c81" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "cinder-quobyte-58a81cf6-c56c-46e1-90e6-b5449fe90c81" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedad0e3-7369-449b-aed7-e73948e80e40]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:26 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 Nov 03 18:26:26 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:27 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81" returned: 0 in 0.690s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:27 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81 Nov 03 18:26:27 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:27 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58a81cf6-c56c-46e1-90e6-b5449fe90c81" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "cinder-quobyte-58a81cf6-c56c-46e1-90e6-b5449fe90c81" released by "delete_volume" :: held 1.188s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Created reservations ['8f2e9837-087e-4e8d-b1bd-a8f2dcf9bc35', '4110af2c-6c5f-43a3-8760-582fb0aebb22', '991e343b-3b4a-4917-96ed-fb1a11a452cf', 'e76735b8-a7dc-40ee-b581-049eb8e37e36'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:27 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:27 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:28 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.484s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:28 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Deleted volume successfully. Nov 03 18:26:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dfa2b260-63cb-47b3-908f-bd57f04aca44 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "cinder-58a81cf6-c56c-46e1-90e6-b5449fe90c81-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Flow 'volume_create_manager' (468cecc7-5910-4efd-9212-5a43f3c688d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b4dd21-02ca-4da5-a8f3-f847c1a1cf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b4dd21-02ca-4da5-a8f3-f847c1a1cf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545732002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e430c74-df0c-4330-9697-5cf903d05b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a0f6883424a5aa65ad1bf270c2bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:29Z,use_quota=True,user_id='8f5271b318b74adf9c170a0967df8819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9af326f-0343-42a5-925f-d722b035900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9af326f-0343-42a5-925f-d722b035900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a0dce4-43fb-49c6-b787-647c7459ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a0dce4-43fb-49c6-b787-647c7459ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e430c74-df0c-4330-9697-5cf903d05b75', 'volume_name': 'volume-8e430c74-df0c-4330-9697-5cf903d05b75', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467ea176-d29c-4da2-8bc1-a2edef50c62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467ea176-d29c-4da2-8bc1-a2edef50c62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43e49f8-accd-4235-a1ff-1dc26c05fcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Volume 8e430c74-df0c-4330-9697-5cf903d05b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e430c74-df0c-4330-9697-5cf903d05b75', 'volume_size': 1} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1545732002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e430c74-df0c-4330-9697-5cf903d05b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a0f6883424a5aa65ad1bf270c2bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:29Z,use_quota=True,user_id='8f5271b318b74adf9c170a0967df8819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Creating volume 8e430c74-df0c-4330-9697-5cf903d05b75 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:29 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:29 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 1073741824 Nov 03 18:26:29 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:30 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 1073741824" returned: 0 in 0.923s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:30 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 Nov 03 18:26:30 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:31 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75" returned: 0 in 0.734s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43e49f8-accd-4235-a1ff-1dc26c05fcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e430c74-df0c-4330-9697-5cf903d05b75', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b954b1-5b37-48eb-82f9-dbca6f14f765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:31 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Volume volume-8e430c74-df0c-4330-9697-5cf903d05b75 (8e430c74-df0c-4330-9697-5cf903d05b75): created successfully Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b954b1-5b37-48eb-82f9-dbca6f14f765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Flow 'volume_create_manager' (468cecc7-5910-4efd-9212-5a43f3c688d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3eb632c2-0118-456c-99fb-f1085f90df54 tempest-VolumeQuotasAdminTestJSON-167932244 None] Created volume successfully. Nov 03 18:26:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-28cad312-c00d-480e-a132-0c599a17725b tempest-VolumeQuotasAdminTestJSON-2014666352 None] Transfer volume completed successfully. Nov 03 18:26:33 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Flow 'volume_create_manager' (37996186-7fce-4258-ab5d-b63bd93c64f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb524f2-536d-4af4-a718-5e0c91c3e5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb524f2-536d-4af4-a718-5e0c91c3e5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-204759887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cec7b48-b751-4bd8-b6fb-178cd9d4019e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb5a5fe77a44744b792d3467d2266a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:34Z,use_quota=True,user_id='64e1b45578484a01a7f08a880dfaf044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c8269c-a87c-4ccb-954b-3e517c8bd2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c8269c-a87c-4ccb-954b-3e517c8bd2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0212493e-e951-4462-bed3-4101b5b8d5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0212493e-e951-4462-bed3-4101b5b8d5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cec7b48-b751-4bd8-b6fb-178cd9d4019e', 'volume_name': 'volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcda2fa-f285-4a49-bf4b-1dda113f16b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcda2fa-f285-4a49-bf4b-1dda113f16b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9f45ee-c7ed-4fd9-b62a-35e55b668093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Volume 8cec7b48-b751-4bd8-b6fb-178cd9d4019e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e', 'volume_size': 1} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-204759887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cec7b48-b751-4bd8-b6fb-178cd9d4019e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb5a5fe77a44744b792d3467d2266a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:34Z,use_quota=True,user_id='64e1b45578484a01a7f08a880dfaf044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Creating volume 8cec7b48-b751-4bd8-b6fb-178cd9d4019e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:34 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:34 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e 1073741824 Nov 03 18:26:34 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Acquiring lock "cinder-8e430c74-df0c-4330-9697-5cf903d05b75-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Lock "cinder-8e430c74-df0c-4330-9697-5cf903d05b75-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Acquiring lock "cinder-quobyte-8e430c74-df0c-4330-9697-5cf903d05b75" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Lock "cinder-quobyte-8e430c74-df0c-4330-9697-5cf903d05b75" acquired by "delete_volume" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[861aac3a-dd2e-449d-a2ff-2030f7f68023]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:34 devstack sudo[93319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 Nov 03 18:26:34 devstack sudo[93319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:35 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e 1073741824" returned: 0 in 0.956s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:35 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e Nov 03 18:26:35 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:35 devstack sudo[93319]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75" returned: 0 in 0.906s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:35 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75 Nov 03 18:26:35 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:35 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e" returned: 0 in 0.588s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9f45ee-c7ed-4fd9-b62a-35e55b668093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f03803-8fa8-48fa-9930-dc78d8f36936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:35 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Volume volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e (8cec7b48-b751-4bd8-b6fb-178cd9d4019e): created successfully Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f03803-8fa8-48fa-9930-dc78d8f36936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Flow 'volume_create_manager' (37996186-7fce-4258-ab5d-b63bd93c64f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-92c431ac-4a86-4815-b8d0-aa39b2b8f171 tempest-VolumesListAdminTestJSON-2031573337 None] Created volume successfully. Nov 03 18:26:36 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8e430c74-df0c-4330-9697-5cf903d05b75" returned: 0 in 0.702s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Lock "cinder-quobyte-8e430c74-df0c-4330-9697-5cf903d05b75" released by "delete_volume" :: held 1.759s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Created reservations ['ccf7f4d3-6ae0-4ae9-a29e-31565a85b6c4', '08242f71-3bd8-48a5-b9ae-d36e3830105d', 'ff6e3994-ab0a-4192-8f27-49fda6456cc6', '1c6515e2-ff39-408b-8a41-de8639b5a509'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:36 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:36 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:37 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.610s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Deleted volume successfully. Nov 03 18:26:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e8379e44-d22e-4d28-89a3-9b34a4e6b68f tempest-VolumeQuotasAdminTestJSON-985791904 None] Lock "cinder-8e430c74-df0c-4330-9697-5cf903d05b75-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:38 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Flow 'volume_create_manager' (d238a00e-21f9-45ad-a52a-697b5f398ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ea37dd-d4bb-4696-b172-b3263d874f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ea37dd-d4bb-4696-b172-b3263d874f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-812506362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cf007a-77db-4d38-ac71-63772c13c4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb5a5fe77a44744b792d3467d2266a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:39Z,use_quota=True,user_id='64e1b45578484a01a7f08a880dfaf044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5930653c-31ce-4c1c-bf4f-d12449c36021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5930653c-31ce-4c1c-bf4f-d12449c36021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0836f0-538e-4028-89bc-242bdfdd6e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d0836f0-538e-4028-89bc-242bdfdd6e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5cf007a-77db-4d38-ac71-63772c13c4f2', 'volume_name': 'volume-e5cf007a-77db-4d38-ac71-63772c13c4f2', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13de0bc5-065e-4cc8-85d7-613537812704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13de0bc5-065e-4cc8-85d7-613537812704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1690c15-b52f-43ca-bce8-013bd9e06ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:39 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Volume e5cf007a-77db-4d38-ac71-63772c13c4f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5cf007a-77db-4d38-ac71-63772c13c4f2', 'volume_size': 1} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-812506362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5cf007a-77db-4d38-ac71-63772c13c4f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb5a5fe77a44744b792d3467d2266a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:39Z,use_quota=True,user_id='64e1b45578484a01a7f08a880dfaf044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Creating volume e5cf007a-77db-4d38-ac71-63772c13c4f2 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:39 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:39 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 1073741824 Nov 03 18:26:39 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:40 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 1073741824" returned: 0 in 0.964s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:40 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 Nov 03 18:26:40 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:40 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2" returned: 0 in 0.396s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1690c15-b52f-43ca-bce8-013bd9e06ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5cf007a-77db-4d38-ac71-63772c13c4f2', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcc609d-9745-45d5-8e3f-b5ebcb20a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Volume volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 (e5cf007a-77db-4d38-ac71-63772c13c4f2): created successfully Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfcc609d-9745-45d5-8e3f-b5ebcb20a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Flow 'volume_create_manager' (d238a00e-21f9-45ad-a52a-697b5f398ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:40 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e587e6aa-6ca7-4fc7-af56-29f54646aef4 tempest-VolumesListAdminTestJSON-2031573337 None] Created volume successfully. Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Flow 'volume_create_manager' (a7ab6620-7be3-4ff7-a759-e7e0674aea03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd53b6b-1971-4f7f-8bfb-162fd34d625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd53b6b-1971-4f7f-8bfb-162fd34d625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1505036055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989c8100-4ce9-491e-a6f2-c6407a3907f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb5a5fe77a44744b792d3467d2266a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:42Z,use_quota=True,user_id='64e1b45578484a01a7f08a880dfaf044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2015e91a-2c5b-4439-8f4e-59b95bf5f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2015e91a-2c5b-4439-8f4e-59b95bf5f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdbe9b0-dfea-416b-8442-1b655b03f81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fdbe9b0-dfea-416b-8442-1b655b03f81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989c8100-4ce9-491e-a6f2-c6407a3907f3', 'volume_name': 'volume-989c8100-4ce9-491e-a6f2-c6407a3907f3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59889d1e-c21e-4c8a-a247-2244f94f031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59889d1e-c21e-4c8a-a247-2244f94f031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d245c74b-f6d7-441c-bca0-5cc60fb4c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Volume 989c8100-4ce9-491e-a6f2-c6407a3907f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989c8100-4ce9-491e-a6f2-c6407a3907f3', 'volume_size': 1} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1505036055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989c8100-4ce9-491e-a6f2-c6407a3907f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb5a5fe77a44744b792d3467d2266a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:42Z,use_quota=True,user_id='64e1b45578484a01a7f08a880dfaf044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Creating volume 989c8100-4ce9-491e-a6f2-c6407a3907f3 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:41 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:41 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 1073741824 Nov 03 18:26:41 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:42 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 1073741824" returned: 0 in 0.702s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:42 devstack sudo[93444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 Nov 03 18:26:42 devstack sudo[93444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:42 devstack sudo[93444]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3" returned: 0 in 0.456s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d245c74b-f6d7-441c-bca0-5cc60fb4c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989c8100-4ce9-491e-a6f2-c6407a3907f3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8bb3b2-db23-42fc-9b04-6f7bc153def0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:43 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Volume volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 (989c8100-4ce9-491e-a6f2-c6407a3907f3): created successfully Nov 03 18:26:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8bb3b2-db23-42fc-9b04-6f7bc153def0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:43 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Flow 'volume_create_manager' (a7ab6620-7be3-4ff7-a759-e7e0674aea03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:43 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-662c00c1-d92a-425e-abf3-cb2ef3d67ed0 tempest-VolumesListAdminTestJSON-2031573337 None] Created volume successfully. Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Flow 'volume_create_manager' (06b5bfb5-5d0c-42dc-b4de-11c725a41834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eebd9be-3ac1-44af-9167-8f1780d7bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eebd9be-3ac1-44af-9167-8f1780d7bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0a8945-3736-40ed-8538-c60fecd8a0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1888e4b47a4de089a2c98e3cbd342d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:45Z,use_quota=True,user_id='c8680605fa4841808c282fab59b24bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f7809-94cc-4fa6-a808-e59487935a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f7809-94cc-4fa6-a808-e59487935a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903ba6b0-138e-42e7-a40c-1cdf00eea9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (903ba6b0-138e-42e7-a40c-1cdf00eea9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0a8945-3736-40ed-8538-c60fecd8a0a0', 'volume_name': 'volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd37c3-cf2c-4521-8bbc-e97f19a5065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd37c3-cf2c-4521-8bbc-e97f19a5065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be435d8-102b-4db0-923b-03656b9cf81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Volume 6e0a8945-3736-40ed-8538-c60fecd8a0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0', 'volume_size': 1} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0a8945-3736-40ed-8538-c60fecd8a0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1888e4b47a4de089a2c98e3cbd342d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:45Z,use_quota=True,user_id='c8680605fa4841808c282fab59b24bd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Creating volume 6e0a8945-3736-40ed-8538-c60fecd8a0a0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:45 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:45 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 1073741824 Nov 03 18:26:45 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:46 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 1073741824" returned: 0 in 1.090s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:46 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 Nov 03 18:26:46 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:47 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0" returned: 0 in 0.548s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be435d8-102b-4db0-923b-03656b9cf81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef79006d-ccc5-403b-bfbb-c3656b0b5a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Volume volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 (6e0a8945-3736-40ed-8538-c60fecd8a0a0): created successfully Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef79006d-ccc5-403b-bfbb-c3656b0b5a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Flow 'volume_create_manager' (06b5bfb5-5d0c-42dc-b4de-11c725a41834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-90d69b62-9c49-463d-b024-53f4c0b5e8b1 tempest-VolumesListAdminTestJSON-1867990750 None] Created volume successfully. Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Flow 'volume_create_manager' (d34df81e-e428-4f6d-82ca-efb48c970fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fea116a-1fd1-49df-b25d-4b9084afd6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Acquiring lock "cinder-6e0a8945-3736-40ed-8538-c60fecd8a0a0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fea116a-1fd1-49df-b25d-4b9084afd6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-285972853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082d9067-1485-4269-94bb-96aea6a4b973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b0c6659d3416b9f5e742ac8b8d856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:48Z,use_quota=True,user_id='aaa68de8e72c403c881d9d50b34229b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb21a75-780d-476a-825e-6a7ca4f7b855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb21a75-780d-476a-825e-6a7ca4f7b855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44f5d5-479e-48de-9f39-0242a8113b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac44f5d5-479e-48de-9f39-0242a8113b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082d9067-1485-4269-94bb-96aea6a4b973', 'volume_name': 'volume-082d9067-1485-4269-94bb-96aea6a4b973', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd72c7-db04-49b5-b8c6-4aa07572c7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dd72c7-db04-49b5-b8c6-4aa07572c7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae074a4d-cf90-4d01-8c26-778035e368af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:48 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Volume 082d9067-1485-4269-94bb-96aea6a4b973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082d9067-1485-4269-94bb-96aea6a4b973', 'volume_size': 1} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-285972853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082d9067-1485-4269-94bb-96aea6a4b973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b0c6659d3416b9f5e742ac8b8d856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:48Z,use_quota=True,user_id='aaa68de8e72c403c881d9d50b34229b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Creating volume 082d9067-1485-4269-94bb-96aea6a4b973 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:48 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "cinder-989c8100-4ce9-491e-a6f2-c6407a3907f3-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "cinder-6e0a8945-3736-40ed-8538-c60fecd8a0a0-delete_volume" acquired by "delete_volume" :: waited 0.274s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:48 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 1073741824 Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-989c8100-4ce9-491e-a6f2-c6407a3907f3-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:48 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Acquiring lock "cinder-quobyte-6e0a8945-3736-40ed-8538-c60fecd8a0a0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "cinder-quobyte-6e0a8945-3736-40ed-8538-c60fecd8a0a0" acquired by "delete_volume" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "cinder-quobyte-989c8100-4ce9-491e-a6f2-c6407a3907f3" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfefb964-4769-42df-be21-2eaa64e7facf]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-quobyte-989c8100-4ce9-491e-a6f2-c6407a3907f3" acquired by "delete_volume" :: waited 0.072s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ecb7f5-c0ea-449e-99c7-ac6f15ff62c5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:48 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 Nov 03 18:26:48 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:48 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 Nov 03 18:26:48 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:49 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3" returned: 0 in 0.585s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:49 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0" returned: 0 in 0.751s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:49 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3 Nov 03 18:26:49 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:49 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0 Nov 03 18:26:49 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:49 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 1073741824" returned: 0 in 1.170s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:49 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 Nov 03 18:26:49 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:49 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-989c8100-4ce9-491e-a6f2-c6407a3907f3" returned: 0 in 0.476s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-quobyte-989c8100-4ce9-491e-a6f2-c6407a3907f3" released by "delete_volume" :: held 1.181s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Created reservations ['587f5b3a-7b29-4b12-b230-121a83957920', 'ea886854-163b-424f-8329-2447eab48366', '80cf57b3-d934-49f6-aef8-ba8a02224455', 'a23b8d3e-847c-4cbd-a716-2360ba30afca'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:49 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6e0a8945-3736-40ed-8538-c60fecd8a0a0" returned: 0 in 0.648s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:49 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973" returned: 0 in 0.415s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "cinder-quobyte-6e0a8945-3736-40ed-8538-c60fecd8a0a0" released by "delete_volume" :: held 1.514s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae074a4d-cf90-4d01-8c26-778035e368af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082d9067-1485-4269-94bb-96aea6a4b973', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e5367c-55c3-47a3-942b-494ff071ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Volume volume-082d9067-1485-4269-94bb-96aea6a4b973 (082d9067-1485-4269-94bb-96aea6a4b973): created successfully Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7e5367c-55c3-47a3-942b-494ff071ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Flow 'volume_create_manager' (d34df81e-e428-4f6d-82ca-efb48c970fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e864c37a-3afd-447b-b6c4-93c12cd22096 tempest-ServersNegativeTestJSON-1838143942 None] Created volume successfully. Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Created reservations ['c9828215-09f5-4d67-8228-368a578a9ce7', '5af18817-0ce1-4a31-bc10-b85a7ee3ad99', '34c3afcd-5176-434f-acbc-db08ca95666a', '1325422f-9ba8-4191-ad18-c379dce12ff6'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:50 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:50 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:50 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:50 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:50 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.345s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Deleted volume successfully. Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b327ec8-35a8-40e7-86b0-e0d8d99c1810 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-989c8100-4ce9-491e-a6f2-c6407a3907f3-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:50 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.446s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Deleted volume successfully. Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-faaffdf3-eacb-4d6a-a7e8-089112cece87 tempest-VolumesListAdminTestJSON-1867990750 None] Lock "cinder-6e0a8945-3736-40ed-8538-c60fecd8a0a0-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "cinder-e5cf007a-77db-4d38-ac71-63772c13c4f2-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-e5cf007a-77db-4d38-ac71-63772c13c4f2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "cinder-quobyte-e5cf007a-77db-4d38-ac71-63772c13c4f2" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-quobyte-e5cf007a-77db-4d38-ac71-63772c13c4f2" acquired by "delete_volume" :: waited 0.040s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:51 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ead6d-5f7d-4139-8ac4-204bc0904b31]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:51 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 Nov 03 18:26:51 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:51 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2" returned: 0 in 0.534s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:51 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2 Nov 03 18:26:51 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:51 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5cf007a-77db-4d38-ac71-63772c13c4f2" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-quobyte-e5cf007a-77db-4d38-ac71-63772c13c4f2" released by "delete_volume" :: held 0.967s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Created reservations ['28443cee-9a9a-42d3-bbf2-ea74a7fa6c1c', 'e9eeb46e-2875-42a8-8388-4157127a84c7', 'bc63aeae-1bb9-4db0-a402-93270195237e', 'b8c44cfb-8705-46ef-9954-c03062e399fe'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:52 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:52 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:52 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.330s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Deleted volume successfully. Nov 03 18:26:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e57cbb9f-c481-42d3-9c01-68dc9770e8cd tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-e5cf007a-77db-4d38-ac71-63772c13c4f2-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Flow 'volume_create_manager' (415ccab4-21d5-408f-987e-dd762d447298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf3fc42-1c69-4180-adee-ff6ec9ae5b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "cinder-8cec7b48-b751-4bd8-b6fb-178cd9d4019e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf3fc42-1c69-4180-adee-ff6ec9ae5b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-186930073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee33cc6-e0d3-464c-b3d3-91784383e111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b0c6659d3416b9f5e742ac8b8d856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:53Z,use_quota=True,user_id='aaa68de8e72c403c881d9d50b34229b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c355b6b-3945-4bad-a311-e6f1ed2e27a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c355b6b-3945-4bad-a311-e6f1ed2e27a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8770dfea-9f50-472c-bbe4-3aa8df8b7fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8770dfea-9f50-472c-bbe4-3aa8df8b7fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee33cc6-e0d3-464c-b3d3-91784383e111', 'volume_name': 'volume-7ee33cc6-e0d3-464c-b3d3-91784383e111', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a46dbb-b3d3-4c3b-bf87-8c5923696416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a46dbb-b3d3-4c3b-bf87-8c5923696416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d88c26-578c-41c0-a9ce-2d6537f98c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Volume 7ee33cc6-e0d3-464c-b3d3-91784383e111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee33cc6-e0d3-464c-b3d3-91784383e111', 'volume_size': 1} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-186930073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee33cc6-e0d3-464c-b3d3-91784383e111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758b0c6659d3416b9f5e742ac8b8d856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:53Z,use_quota=True,user_id='aaa68de8e72c403c881d9d50b34229b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Creating volume 7ee33cc6-e0d3-464c-b3d3-91784383e111 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:53 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-8cec7b48-b751-4bd8-b6fb-178cd9d4019e-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:53 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 1073741824 Nov 03 18:26:53 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "cinder-quobyte-8cec7b48-b751-4bd8-b6fb-178cd9d4019e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-quobyte-8cec7b48-b751-4bd8-b6fb-178cd9d4019e" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6a80f8-09c9-42d7-b3b4-52699cc33ab3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:53 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e Nov 03 18:26:53 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Flow 'volume_create_manager' (011ab51d-b3e5-43b7-9bda-34c9379811e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70774acc-b503-4235-b0d0-99747aee7dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70774acc-b503-4235-b0d0-99747aee7dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1437128544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e99478781a4c51a9c9f93714dc3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:54Z,use_quota=True,user_id='2c7b3ba0639249f0a7808b1933990b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada62ee7-1fc9-4838-bb83-6689273b13b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada62ee7-1fc9-4838-bb83-6689273b13b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d37fd98-bb11-4f38-8b47-455be8a1437c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d37fd98-bb11-4f38-8b47-455be8a1437c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe', 'volume_name': 'volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d1477c-586a-4892-9c2d-a65f9dc0c4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d1477c-586a-4892-9c2d-a65f9dc0c4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a2290c-ab87-4522-a7b7-7fa67c11d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Volume 4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe', 'volume_size': 1} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:53 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 1073741824" returned: 0 in 0.498s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:53 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 Nov 03 18:26:53 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:54 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e" returned: 0 in 0.464s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:54 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e Nov 03 18:26:54 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:54 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1437128544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e99478781a4c51a9c9f93714dc3a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:26:54Z,use_quota=True,user_id='2c7b3ba0639249f0a7808b1933990b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Creating volume 4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:26:54 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d88c26-578c-41c0-a9ce-2d6537f98c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee33cc6-e0d3-464c-b3d3-91784383e111', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:54 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe 1073741824 Nov 03 18:26:54 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93400228-f930-44f5-b5ae-e2aff811b07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Volume volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 (7ee33cc6-e0d3-464c-b3d3-91784383e111): created successfully Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93400228-f930-44f5-b5ae-e2aff811b07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Flow 'volume_create_manager' (415ccab4-21d5-408f-987e-dd762d447298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-20d84fff-b9d5-47e8-ae58-6b244030ce5d tempest-ServersNegativeTestJSON-1838143942 None] Created volume successfully. Nov 03 18:26:54 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8cec7b48-b751-4bd8-b6fb-178cd9d4019e" returned: 0 in 0.325s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-quobyte-8cec7b48-b751-4bd8-b6fb-178cd9d4019e" released by "delete_volume" :: held 0.854s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Created reservations ['99ae4a47-66e4-4d45-8e16-94b67201ba8e', '61968e75-24a8-479a-a767-6742cc7c4d70', '439e1a88-c640-43c3-9b2c-e773c3652b94', '8c700115-cd16-4336-b33b-e45cf1f24a59'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:54 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:54 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:54 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe 1073741824" returned: 0 in 0.503s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:54 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:54 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe Nov 03 18:26:54 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Deleted volume successfully. Nov 03 18:26:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae905d6d-5ffa-44be-8d85-498a428ce089 tempest-VolumesListAdminTestJSON-2031573337 None] Lock "cinder-8cec7b48-b751-4bd8-b6fb-178cd9d4019e-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:55 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe" returned: 0 in 0.268s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a2290c-ab87-4522-a7b7-7fa67c11d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d601e5e-7f8a-41e0-a2af-bdfd21bd7564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:26:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Volume volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe (4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe): created successfully Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d601e5e-7f8a-41e0-a2af-bdfd21bd7564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Flow 'volume_create_manager' (011ab51d-b3e5-43b7-9bda-34c9379811e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:26:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-080b6825-df77-4bb4-a0d1-2f67871e7b7d tempest-VolumesServicesTestJSON-1075968077 None] Created volume successfully. Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "cinder-7ee33cc6-e0d3-464c-b3d3-91784383e111-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-7ee33cc6-e0d3-464c-b3d3-91784383e111-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "cinder-quobyte-7ee33cc6-e0d3-464c-b3d3-91784383e111" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-quobyte-7ee33cc6-e0d3-464c-b3d3-91784383e111" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d498342d-07b3-4268-985b-4050842b30ad]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:56 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 Nov 03 18:26:56 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Acquiring lock "cinder-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Lock "cinder-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Acquiring lock "cinder-quobyte-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Lock "cinder-quobyte-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e861c988-9fb2-4640-b59c-5f0755485f91]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:56 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe Nov 03 18:26:56 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:56 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111" returned: 0 in 0.547s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:56 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111 Nov 03 18:26:56 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:56 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7ee33cc6-e0d3-464c-b3d3-91784383e111" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-quobyte-7ee33cc6-e0d3-464c-b3d3-91784383e111" released by "delete_volume" :: held 0.896s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:56 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe" returned: 0 in 0.525s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:56 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe Nov 03 18:26:56 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Created reservations ['2a917614-84f3-4c4f-92d8-d3f9bd87b10f', '6fb9517b-f9f2-4a35-99d2-aa5d763dd219', '325cf294-8f20-41a2-abe0-764daeed789f', 'a6f2d5ed-2d38-4731-af93-8b568113f8d1'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:56 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:56 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:57 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe" returned: 0 in 0.321s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Lock "cinder-quobyte-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe" released by "delete_volume" :: held 0.916s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Created reservations ['eaaaf589-5958-44e4-be4e-f2d7c4c9aca0', '1bd369df-7766-4060-8106-5a5966c9fa83', '91bcfa4c-bd18-4c94-a563-3e124a112619', '8b63c7a5-d3c2-4337-abe0-f368796a0c7e'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:57 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:57 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:57 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.461s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Deleted volume successfully. Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-56ea7600-fe18-416b-a5e8-b36e9fec9238 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-7ee33cc6-e0d3-464c-b3d3-91784383e111-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:57 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.385s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Deleted volume successfully. Nov 03 18:26:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1692dc08-e828-4a8b-b722-071a528b3bb2 tempest-VolumesServicesTestJSON-1075968077 None] Lock "cinder-4019a2be-6a8f-4b68-b0bd-3ba3bc164bfe-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "cinder-082d9067-1485-4269-94bb-96aea6a4b973-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-082d9067-1485-4269-94bb-96aea6a4b973-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "cinder-quobyte-082d9067-1485-4269-94bb-96aea6a4b973" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-quobyte-082d9067-1485-4269-94bb-96aea6a4b973" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[97643d62-c70f-4933-93dc-7e1da7e3f835]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:58 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 Nov 03 18:26:58 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:58 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973" returned: 0 in 0.560s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:58 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973 Nov 03 18:26:58 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:59 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-082d9067-1485-4269-94bb-96aea6a4b973" returned: 0 in 0.473s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-quobyte-082d9067-1485-4269-94bb-96aea6a4b973" released by "delete_volume" :: held 1.105s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Created reservations ['148dbe39-9f22-456a-9747-1153b822ace3', '4ed2b448-ba24-485a-af32-89f3f68a129f', '7103a52e-32b4-47bb-8676-f99575646a58', '43c33b90-0384-4026-bc45-b791e22d924d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:26:59 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:59 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:26:59 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:26:59 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:26:59 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.324s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:26:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:26:59 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.313s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Deleted volume successfully. Nov 03 18:27:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0579c394-1941-44f6-92ae-3152685f37c9 tempest-ServersNegativeTestJSON-1838143942 None] Lock "cinder-082d9067-1485-4269-94bb-96aea6a4b973-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Flow 'volume_create_manager' (bc654ad2-f0b0-4db9-804c-6053b547a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3ba840-ea56-4ec7-9bd5-927a8f87fe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3ba840-ea56-4ec7-9bd5-927a8f87fe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1663953399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91862ae0-1989-42a5-b427-d419d06c9dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b40abf92ee4c0a9040904a4ccbb584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:04Z,use_quota=True,user_id='34f239ccdc4348fa9ece048596b0e741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512e47f6-7bbf-45ac-b66d-0c9391e3466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512e47f6-7bbf-45ac-b66d-0c9391e3466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db34be8-3736-4522-aa96-d574f043482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:03 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db34be8-3736-4522-aa96-d574f043482d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '91862ae0-1989-42a5-b427-d419d06c9dbf', 'volume_name': 'volume-91862ae0-1989-42a5-b427-d419d06c9dbf', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0891322b-0648-4823-b637-4627caf140f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0891322b-0648-4823-b637-4627caf140f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703feea7-eff6-43bb-8b3e-11d0029d9a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Volume 91862ae0-1989-42a5-b427-d419d06c9dbf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-91862ae0-1989-42a5-b427-d419d06c9dbf', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Trying to clone 91862ae0-1989-42a5-b427-d419d06c9dbf from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:27:04 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Image download 20.69 MB at 20.69 MB/s Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9868b18-c4a2-4990-b0c2-c9cf06cbbf6c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:05 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD Nov 03 18:27:05 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:05 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb is fetched for user 34f239ccdc4348fa9ece048596b0e741. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ccd760-9a98-4938-b68e-ee8ad1c74370]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:05 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD Nov 03 18:27:05 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:05 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1663953399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91862ae0-1989-42a5-b427-d419d06c9dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b40abf92ee4c0a9040904a4ccbb584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:04Z,use_quota=True,user_id='34f239ccdc4348fa9ece048596b0e741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Creating volume 91862ae0-1989-42a5-b427-d419d06c9dbf {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:05 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:05 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf 1073741824 Nov 03 18:27:05 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Flow 'volume_create_manager' (3019ef2b-a23c-408e-bcf7-0f16018d0767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca244ff5-074d-472f-bbaa-3970919581b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca244ff5-074d-472f-bbaa-3970919581b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-301371436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9d661b-9243-42f1-bf2f-8d3b37f24032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4723edb99143aba5460b5ea91e0231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:06Z,use_quota=True,user_id='773d58c3b3594d42b1ffe82e14f6dc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e58fd2be-daeb-4d48-8c5c-5074e5b2842b),volume_type_id=e58fd2be-daeb-4d48-8c5c-5074e5b2842b)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46600d2-ebfe-443f-ac3c-473640a2d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46600d2-ebfe-443f-ac3c-473640a2d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b277cb4b-c442-4cdd-a9a1-efcc72104f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b277cb4b-c442-4cdd-a9a1-efcc72104f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9d661b-9243-42f1-bf2f-8d3b37f24032', 'volume_name': 'volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1d31bc-0155-4d14-ab30-63314685996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b1d31bc-0155-4d14-ab30-63314685996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928be77a-24ab-49fb-acf7-b2c42fd7a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:06 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Volume ff9d661b-9243-42f1-bf2f-8d3b37f24032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032', 'volume_size': 1} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:06 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf 1073741824" returned: 0 in 0.509s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:06 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf Nov 03 18:27:06 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:06 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf" returned: 0 in 0.312s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-301371436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9d661b-9243-42f1-bf2f-8d3b37f24032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4723edb99143aba5460b5ea91e0231',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:06Z,use_quota=True,user_id='773d58c3b3594d42b1ffe82e14f6dc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e58fd2be-daeb-4d48-8c5c-5074e5b2842b),volume_type_id=e58fd2be-daeb-4d48-8c5c-5074e5b2842b)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Creating volume ff9d661b-9243-42f1-bf2f-8d3b37f24032 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:06 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Attempting download of 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume 91862ae0-1989-42a5-b427-d419d06c9dbf. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:27:06 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 1073741824 Nov 03 18:27:06 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe72abf-403f-4412-a81a-1826329cf28b]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:07 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b Nov 03 18:27:07 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:07 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:07 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 1073741824" returned: 0 in 0.511s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:07 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b Nov 03 18:27:07 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:07 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 Nov 03 18:27:07 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:07 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b" returned: 1 in 0.415s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_30cgco7b' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ec20a-5cf6-45b7-9d88-af7685887659]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:07 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:07 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD Nov 03 18:27:07 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928be77a-24ab-49fb-acf7-b2c42fd7a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50968a9-e53b-433c-b9fe-447aafc24374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:07 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Volume volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 (ff9d661b-9243-42f1-bf2f-8d3b37f24032): created successfully Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c50968a9-e53b-433c-b9fe-447aafc24374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Flow 'volume_create_manager' (3019ef2b-a23c-408e-bcf7-0f16018d0767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b47896a3-effc-484f-8f17-d10f4fe0a9a8 tempest-VolumeTypesAccessTest-1552094936 None] Created volume successfully. Nov 03 18:27:08 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:08 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] 3cc5f1a8-28a8-4446-80b6-6636c7f415bb was qcow2, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:27:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:08 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf Nov 03 18:27:08 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Acquiring lock "cinder-ff9d661b-9243-42f1-bf2f-8d3b37f24032-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Lock "cinder-ff9d661b-9243-42f1-bf2f-8d3b37f24032-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Acquiring lock "cinder-quobyte-ff9d661b-9243-42f1-bf2f-8d3b37f24032" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Lock "cinder-quobyte-ff9d661b-9243-42f1-bf2f-8d3b37f24032" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a4a449-2384-41e1-9bc2-9f83eb835ec9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:09 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 Nov 03 18:27:09 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:09 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032" returned: 0 in 0.430s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:09 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032 Nov 03 18:27:09 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:10 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff9d661b-9243-42f1-bf2f-8d3b37f24032" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Lock "cinder-quobyte-ff9d661b-9243-42f1-bf2f-8d3b37f24032" released by "delete_volume" :: held 0.768s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:10 devstack cinder-volume[86841]: WARNING cinder.quota [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-875038390 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-875038390, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:27:10 devstack cinder-volume[86841]: WARNING cinder.quota [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-875038390 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-875038390, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Created reservations ['989c32c4-4c4c-4df1-8597-16316374a38e', '02078a9b-0ab9-4c83-98ba-339237b01486', '5c3652e4-158b-428a-b602-b81bef9be8fd', 'ae9e9782-56fc-4612-ad64-88f629a0634d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:10 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:10 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:10 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf" returned: 0 in 2.300s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_8blkdob3devstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:27:10 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Converted 112.00 MB image at 48.65 MB/s Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:10 devstack sudo[93794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf 1G Nov 03 18:27:10 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:10 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.398s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Deleted volume successfully. Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7f378b0f-4d0a-42e3-9ed5-e89a0b6f5cde tempest-VolumeTypesAccessTest-1552094936 None] Lock "cinder-ff9d661b-9243-42f1-bf2f-8d3b37f24032-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:10 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf 1G" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Downloaded image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume 91862ae0-1989-42a5-b427-d419d06c9dbf successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb for user 34f239ccdc4348fa9ece048596b0e741 is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Marking volume 91862ae0-1989-42a5-b427-d419d06c9dbf as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Copying metadata from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb to 91862ae0-1989-42a5-b427-d419d06c9dbf. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:27:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Creating volume glance metadata for volume 91862ae0-1989-42a5-b427-d419d06c9dbf backed by image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703feea7-eff6-43bb-8b3e-11d0029d9a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91862ae0-1989-42a5-b427-d419d06c9dbf', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef63a94b-5ecd-4353-9605-1f20e982c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Volume volume-91862ae0-1989-42a5-b427-d419d06c9dbf (91862ae0-1989-42a5-b427-d419d06c9dbf): created successfully Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef63a94b-5ecd-4353-9605-1f20e982c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Flow 'volume_create_manager' (bc654ad2-f0b0-4db9-804c-6053b547a784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7e520a8a-60ad-4853-9675-fa799a9a9504 tempest-VolumesImageMetadata-1871820279 None] Created volume successfully. Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Flow 'volume_create_manager' (fb3f8a2c-6a27-4ea1-9e07-e8917993d0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756d75e0-643a-49a6-a744-4c3c5cae9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756d75e0-643a-49a6-a744-4c3c5cae9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1681226339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a82a677-9310-408e-a185-4a670ccf0dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88ab5604ab4a528222c6b19e1c1291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:11Z,use_quota=True,user_id='81d8d2cdf89340a9b7d92c167fdb397b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ffc8da-1cd4-49a6-a675-50f4bf707d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ffc8da-1cd4-49a6-a675-50f4bf707d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9538cd1d-0e18-45cb-a7bb-2debed3b5279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9538cd1d-0e18-45cb-a7bb-2debed3b5279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a82a677-9310-408e-a185-4a670ccf0dbb', 'volume_name': 'volume-5a82a677-9310-408e-a185-4a670ccf0dbb', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ceb39ae-4a34-4a65-8324-66649e3079f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ceb39ae-4a34-4a65-8324-66649e3079f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ffdb45-03b0-4311-809c-e48237902998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Volume 5a82a677-9310-408e-a185-4a670ccf0dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a82a677-9310-408e-a185-4a670ccf0dbb', 'volume_size': 1} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1681226339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a82a677-9310-408e-a185-4a670ccf0dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88ab5604ab4a528222c6b19e1c1291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:11Z,use_quota=True,user_id='81d8d2cdf89340a9b7d92c167fdb397b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Creating volume 5a82a677-9310-408e-a185-4a670ccf0dbb {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:11 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:11 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb 1073741824 Nov 03 18:27:11 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:11 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb 1073741824" returned: 0 in 0.543s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:12 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb Nov 03 18:27:12 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Acquiring lock "cinder-91862ae0-1989-42a5-b427-d419d06c9dbf-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Lock "cinder-91862ae0-1989-42a5-b427-d419d06c9dbf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Acquiring lock "cinder-quobyte-91862ae0-1989-42a5-b427-d419d06c9dbf" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Lock "cinder-quobyte-91862ae0-1989-42a5-b427-d419d06c9dbf" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f06af-6edc-4ed8-bced-a153c5c29fcb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:12 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb" returned: 0 in 0.400s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ffdb45-03b0-4311-809c-e48237902998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a82a677-9310-408e-a185-4a670ccf0dbb', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1094a58e-163e-4afe-ac5d-56d6df6cf8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Volume volume-5a82a677-9310-408e-a185-4a670ccf0dbb (5a82a677-9310-408e-a185-4a670ccf0dbb): created successfully Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1094a58e-163e-4afe-ac5d-56d6df6cf8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Flow 'volume_create_manager' (fb3f8a2c-6a27-4ea1-9e07-e8917993d0d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d9c564de-512b-4d33-a9b3-d58076c036fd tempest-AttachVolumeTestJSON-729153251 None] Created volume successfully. Nov 03 18:27:12 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf Nov 03 18:27:12 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:12 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf" returned: 0 in 0.421s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:12 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf Nov 03 18:27:12 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:13 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91862ae0-1989-42a5-b427-d419d06c9dbf" returned: 0 in 0.339s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Flow 'volume_create_manager' (58031a38-aa78-44fa-b907-a2dbd197ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48aae820-8d92-46a0-9e4d-5f833d3e84d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Lock "cinder-quobyte-91862ae0-1989-42a5-b427-d419d06c9dbf" released by "delete_volume" :: held 0.860s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48aae820-8d92-46a0-9e4d-5f833d3e84d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2042923336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2870060-c7d9-42fd-8396-4545cd0ea9df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87cd72b7fd634c8f862f83bf97dd8454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:13Z,use_quota=True,user_id='4f88aa41cf06431597e4afef03649b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6729e78d-2fe2-410a-8e17-42b62781f59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6729e78d-2fe2-410a-8e17-42b62781f59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c8bfed-f981-4d52-9b51-e5a6afcd9f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c8bfed-f981-4d52-9b51-e5a6afcd9f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2870060-c7d9-42fd-8396-4545cd0ea9df', 'volume_name': 'volume-e2870060-c7d9-42fd-8396-4545cd0ea9df', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3677cb4-e324-4c2b-ade8-5eddddbb933b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3677cb4-e324-4c2b-ade8-5eddddbb933b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7757dccd-8d99-4a8b-a253-f8d9e16a194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Volume e2870060-c7d9-42fd-8396-4545cd0ea9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2870060-c7d9-42fd-8396-4545cd0ea9df', 'volume_size': 1} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2042923336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2870060-c7d9-42fd-8396-4545cd0ea9df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87cd72b7fd634c8f862f83bf97dd8454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:13Z,use_quota=True,user_id='4f88aa41cf06431597e4afef03649b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Creating volume e2870060-c7d9-42fd-8396-4545cd0ea9df {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:13 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:13 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df 1073741824 Nov 03 18:27:13 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Created reservations ['84aa95be-4461-4931-b067-3760fac62485', '3a056b5a-d770-4ca7-86d4-c6469bb542b9', 'cb0cf91c-4952-45b6-b849-11726ac207d6', 'd10a3386-3c0c-4342-8a42-b9cf878d4b4a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:13 devstack sudo[93821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:13 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:13 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.363s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Deleted volume successfully. Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f69b8dce-e1f5-44ea-8704-ed3fe685daee tempest-VolumesImageMetadata-1871820279 None] Lock "cinder-91862ae0-1989-42a5-b427-d419d06c9dbf-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:13 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df 1073741824" returned: 0 in 0.642s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:13 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df Nov 03 18:27:13 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:14 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7757dccd-8d99-4a8b-a253-f8d9e16a194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2870060-c7d9-42fd-8396-4545cd0ea9df', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7eddf7-a0f6-4e08-bca9-e800758d2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Volume volume-e2870060-c7d9-42fd-8396-4545cd0ea9df (e2870060-c7d9-42fd-8396-4545cd0ea9df): created successfully Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7eddf7-a0f6-4e08-bca9-e800758d2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Flow 'volume_create_manager' (58031a38-aa78-44fa-b907-a2dbd197ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-22bf5d73-decd-4ff7-a100-8750dfaa8dd8 tempest-VolumesTestJSON-291375310 None] Created volume successfully. Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-0d4861b1-a883-461e-9f24-00696be25701 req-455a551f-c6f7-42e2-bcd3-4d82ad13f187 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-0d4861b1-a883-461e-9f24-00696be25701 req-455a551f-c6f7-42e2-bcd3-4d82ad13f187 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-0d4861b1-a883-461e-9f24-00696be25701 req-455a551f-c6f7-42e2-bcd3-4d82ad13f187 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-0d4861b1-a883-461e-9f24-00696be25701 req-455a551f-c6f7-42e2-bcd3-4d82ad13f187 tempest-AttachVolumeTestJSON-729153251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-5a82a677-9310-408e-a185-4a670ccf0dbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1247ef46-0326-4125-b6c5-4f71af38bbc8', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:27:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-0d4861b1-a883-461e-9f24-00696be25701 req-455a551f-c6f7-42e2-bcd3-4d82ad13f187 tempest-AttachVolumeTestJSON-729153251 None] attachment_update completed successfully. Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Flow 'volume_create_manager' (08e4a427-807a-4cf6-93e5-160582064d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd80dc9-9f09-4be8-8273-b55f487621c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd80dc9-9f09-4be8-8273-b55f487621c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-653261383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13703cab-d578-49af-895f-1aef586f9239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87cd72b7fd634c8f862f83bf97dd8454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:16Z,use_quota=True,user_id='4f88aa41cf06431597e4afef03649b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b661bb93-7745-4537-a56b-57fa1176ff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b661bb93-7745-4537-a56b-57fa1176ff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c95dca-6c78-4999-b45c-795f91be8154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c95dca-6c78-4999-b45c-795f91be8154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13703cab-d578-49af-895f-1aef586f9239', 'volume_name': 'volume-13703cab-d578-49af-895f-1aef586f9239', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5039ae7e-28d1-4689-99f0-7419b44fd55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5039ae7e-28d1-4689-99f0-7419b44fd55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584441c6-7ee5-4044-ab35-26123bf96979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:16 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Volume 13703cab-d578-49af-895f-1aef586f9239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13703cab-d578-49af-895f-1aef586f9239', 'volume_size': 1} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-653261383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13703cab-d578-49af-895f-1aef586f9239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87cd72b7fd634c8f862f83bf97dd8454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:16Z,use_quota=True,user_id='4f88aa41cf06431597e4afef03649b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Creating volume 13703cab-d578-49af-895f-1aef586f9239 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:16 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:16 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 1073741824 Nov 03 18:27:16 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:16 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 1073741824" returned: 0 in 0.505s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:16 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 Nov 03 18:27:16 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:17 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584441c6-7ee5-4044-ab35-26123bf96979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13703cab-d578-49af-895f-1aef586f9239', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da96adb-f00e-4955-af61-3a6a3a6b678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:17 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Volume volume-13703cab-d578-49af-895f-1aef586f9239 (13703cab-d578-49af-895f-1aef586f9239): created successfully Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da96adb-f00e-4955-af61-3a6a3a6b678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Flow 'volume_create_manager' (08e4a427-807a-4cf6-93e5-160582064d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-938a8ac7-c884-427c-8e95-95c3d0358a8e tempest-VolumesTestJSON-291375310 None] Created volume successfully. Nov 03 18:27:18 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=108,cinder:UPDATE=135,cinder:INSERT=35,cinder:DELETE=8 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:27:18 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=133,cinder:INSERT=36,cinder:DELETE=17,cinder:SELECT=89 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:27:18 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Flow 'volume_create_manager' (a7806848-592b-46e8-bb7e-b2087ec14ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1585c16-9f5f-4380-9c17-4bdd1b8267b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1585c16-9f5f-4380-9c17-4bdd1b8267b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558722910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fd0ac5-0736-45c9-b975-63b975db1638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87cd72b7fd634c8f862f83bf97dd8454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:19Z,use_quota=True,user_id='4f88aa41cf06431597e4afef03649b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75c03b4-100f-4132-b708-e661da55572f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75c03b4-100f-4132-b708-e661da55572f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00fdb15-764a-4c1d-9be1-5d4f4d4ade6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00fdb15-764a-4c1d-9be1-5d4f4d4ade6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fd0ac5-0736-45c9-b975-63b975db1638', 'volume_name': 'volume-95fd0ac5-0736-45c9-b975-63b975db1638', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0078ae31-3e25-4b59-8274-e7eb54557843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0078ae31-3e25-4b59-8274-e7eb54557843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73f4671-13e9-4ecf-a914-47e8f3dcc5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Volume 95fd0ac5-0736-45c9-b975-63b975db1638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fd0ac5-0736-45c9-b975-63b975db1638', 'volume_size': 1} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1558722910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fd0ac5-0736-45c9-b975-63b975db1638,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87cd72b7fd634c8f862f83bf97dd8454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:19Z,use_quota=True,user_id='4f88aa41cf06431597e4afef03649b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Creating volume 95fd0ac5-0736-45c9-b975-63b975db1638 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:19 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:19 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 1073741824 Nov 03 18:27:19 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Flow 'volume_create_manager' (bd33f429-fd9c-4f17-9eb0-d82a6884cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e44d33-8c17-418f-96f3-85c13e762cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 1073741824" returned: 0 in 0.633s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0e44d33-8c17-418f-96f3-85c13e762cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-243244222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53b3275-e5c3-46a9-a097-3961e45a5054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf7e00a814947318d2338d4a495f848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:20Z,use_quota=True,user_id='65ec2d6958ef4b10b4884137f2a3dc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aca233-7a33-4063-822b-adc0e33d6a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0aca233-7a33-4063-822b-adc0e33d6a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a6c4dc-47bf-4be0-a1b6-ea18328136c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a6c4dc-47bf-4be0-a1b6-ea18328136c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53b3275-e5c3-46a9-a097-3961e45a5054', 'volume_name': 'volume-e53b3275-e5c3-46a9-a097-3961e45a5054', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ff1b8f-1b2a-49d8-9208-02cacd33c1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ff1b8f-1b2a-49d8-9208-02cacd33c1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd47636d-d31a-42a0-ab33-5643ac7211f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:19 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Volume e53b3275-e5c3-46a9-a097-3961e45a5054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53b3275-e5c3-46a9-a097-3961e45a5054', 'volume_size': 1} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:19 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 Nov 03 18:27:19 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:20 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638" returned: 0 in 0.277s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-243244222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53b3275-e5c3-46a9-a097-3961e45a5054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf7e00a814947318d2338d4a495f848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:20Z,use_quota=True,user_id='65ec2d6958ef4b10b4884137f2a3dc84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Creating volume e53b3275-e5c3-46a9-a097-3961e45a5054 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:20 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73f4671-13e9-4ecf-a914-47e8f3dcc5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fd0ac5-0736-45c9-b975-63b975db1638', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5af1906-58c6-413e-a33f-65ec648fb70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Volume volume-95fd0ac5-0736-45c9-b975-63b975db1638 (95fd0ac5-0736-45c9-b975-63b975db1638): created successfully Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5af1906-58c6-413e-a33f-65ec648fb70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:20 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 1073741824 Nov 03 18:27:20 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Flow 'volume_create_manager' (a7806848-592b-46e8-bb7e-b2087ec14ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9d5df6ca-070f-4388-b848-018761089e68 tempest-VolumesTestJSON-291375310 None] Created volume successfully. Nov 03 18:27:20 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 1073741824" returned: 0 in 0.871s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:21 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 Nov 03 18:27:21 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:21 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054" returned: 0 in 0.365s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd47636d-d31a-42a0-ab33-5643ac7211f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53b3275-e5c3-46a9-a097-3961e45a5054', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab669dcc-62be-49b3-b612-3254c69359c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:21 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Volume volume-e53b3275-e5c3-46a9-a097-3961e45a5054 (e53b3275-e5c3-46a9-a097-3961e45a5054): created successfully Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab669dcc-62be-49b3-b612-3254c69359c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Flow 'volume_create_manager' (bd33f429-fd9c-4f17-9eb0-d82a6884cc37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:21 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8cf63c69-1088-434a-9b58-31d2ab5f5e8f tempest-AbsoluteLimitsTests-996235024 None] Created volume successfully. Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Acquiring lock "cinder-95fd0ac5-0736-45c9-b975-63b975db1638-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Lock "cinder-95fd0ac5-0736-45c9-b975-63b975db1638-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Acquiring lock "cinder-quobyte-95fd0ac5-0736-45c9-b975-63b975db1638" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Lock "cinder-quobyte-95fd0ac5-0736-45c9-b975-63b975db1638" acquired by "delete_volume" :: waited 0.045s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d0636-9859-4c6f-9eee-1437e85c81ab]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:22 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 Nov 03 18:27:22 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:22 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638" returned: 0 in 0.721s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:23 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638 Nov 03 18:27:23 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Acquiring lock "cinder-e53b3275-e5c3-46a9-a097-3961e45a5054-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Lock "cinder-e53b3275-e5c3-46a9-a097-3961e45a5054-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Acquiring lock "cinder-quobyte-e53b3275-e5c3-46a9-a097-3961e45a5054" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Lock "cinder-quobyte-e53b3275-e5c3-46a9-a097-3961e45a5054" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b43ba0-c3d3-4483-8e82-0d6413b9dca4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:23 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 Nov 03 18:27:23 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:23 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-95fd0ac5-0736-45c9-b975-63b975db1638" returned: 0 in 0.625s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Lock "cinder-quobyte-95fd0ac5-0736-45c9-b975-63b975db1638" released by "delete_volume" :: held 1.465s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Created reservations ['f416c7e6-195b-4658-a38b-82f47b084429', '9b6947ad-aa20-4061-9e1e-7b3d2d3405e1', '28fa91b6-4add-42a1-a55e-b86e4f19fe7b', '889390a7-af2f-4b6c-aa8b-d5ba2a7fa72b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:23 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:23 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:23 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054" returned: 0 in 0.576s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:23 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054 Nov 03 18:27:23 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Acquiring lock "cinder-13703cab-d578-49af-895f-1aef586f9239-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Lock "cinder-13703cab-d578-49af-895f-1aef586f9239-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:24 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.659s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Deleted volume successfully. Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Acquiring lock "cinder-quobyte-13703cab-d578-49af-895f-1aef586f9239" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81959539-72ff-4965-a4dd-b51d3feb0f61 tempest-VolumesTestJSON-291375310 None] Lock "cinder-95fd0ac5-0736-45c9-b975-63b975db1638-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Lock "cinder-quobyte-13703cab-d578-49af-895f-1aef586f9239" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:24 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e53b3275-e5c3-46a9-a097-3961e45a5054" returned: 0 in 0.708s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded9610-d0b6-419e-8349-dcc2726962e5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Lock "cinder-quobyte-e53b3275-e5c3-46a9-a097-3961e45a5054" released by "delete_volume" :: held 1.361s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Created reservations ['edf484cf-7022-449f-b073-65673eb991f6', '74c9df7b-a413-43e4-bfba-30aca891ac28', 'f0d732a0-b4df-4a6d-a875-7084d28078f8', 'de00fdd7-fcc4-48fb-b663-ef2275ccbb56'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:24 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 Nov 03 18:27:24 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:24 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:24 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:25 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239" returned: 0 in 0.658s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:25 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239 Nov 03 18:27:25 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:25 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.595s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Deleted volume successfully. Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd27deb3-cae7-4dd2-ba6e-0bcc39749956 tempest-AbsoluteLimitsTests-996235024 None] Lock "cinder-e53b3275-e5c3-46a9-a097-3961e45a5054-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:25 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-13703cab-d578-49af-895f-1aef586f9239" returned: 0 in 0.462s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Lock "cinder-quobyte-13703cab-d578-49af-895f-1aef586f9239" released by "delete_volume" :: held 1.172s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Created reservations ['cf3cfca4-0b82-4a37-849a-f71b4f558045', 'b94a4025-35bc-4ef8-9321-506c85b83375', '508fe29b-6d23-4717-b266-e9b32e39f2ac', 'd0991812-f2e7-4a98-b219-b7408aa133d1'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:25 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:25 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:26 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.340s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Deleted volume successfully. Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b916de18-e2ff-40a9-a612-c730aaf1fe22 tempest-VolumesTestJSON-291375310 None] Lock "cinder-13703cab-d578-49af-895f-1aef586f9239-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Acquiring lock "cinder-e2870060-c7d9-42fd-8396-4545cd0ea9df-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Lock "cinder-e2870060-c7d9-42fd-8396-4545cd0ea9df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Acquiring lock "cinder-quobyte-e2870060-c7d9-42fd-8396-4545cd0ea9df" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Lock "cinder-quobyte-e2870060-c7d9-42fd-8396-4545cd0ea9df" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c9fb9f-a9d4-467f-9743-3888ec171177]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:27 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df Nov 03 18:27:27 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:27 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df" returned: 0 in 0.542s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:27 devstack sudo[94873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df Nov 03 18:27:27 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:27 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2870060-c7d9-42fd-8396-4545cd0ea9df" returned: 0 in 0.300s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Lock "cinder-quobyte-e2870060-c7d9-42fd-8396-4545cd0ea9df" released by "delete_volume" :: held 0.912s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Created reservations ['ad107f12-121d-4be8-a5f4-9b7da9f74712', 'c7b81fb5-1327-4765-8d20-2cb7df397679', '45121434-9f6b-4f7c-ad88-825e6ee01213', '77703d1b-6b16-469d-bd71-31d820d43786'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:27 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:27 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:28 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.491s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:28 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Deleted volume successfully. Nov 03 18:27:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd9cb956-fe61-4b36-ab2f-3fcffe50d8aa tempest-VolumesTestJSON-291375310 None] Lock "cinder-e2870060-c7d9-42fd-8396-4545cd0ea9df-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7d85c468-ce52-439c-a837-a21c49825e1c tempest-GroupSnapshotsTest-120082620 None] Group tempest-GroupSnapshotsTest-Group-309505178: creating Nov 03 18:27:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7d85c468-ce52-439c-a837-a21c49825e1c tempest-GroupSnapshotsTest-120082620 None] Group tempest-GroupSnapshotsTest-Group-309505178: created successfully Nov 03 18:27:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7d85c468-ce52-439c-a837-a21c49825e1c tempest-GroupSnapshotsTest-120082620 None] Create group completed successfully. Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (abae7b44-7a9c-4b1c-a639-4d90c626e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bbddaa-b2fa-435d-a956-35f590ecb1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bbddaa-b2fa-435d-a956-35f590ecb1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774694935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cbcbe19-f386-4d28-9fa7-028d9986e76e,host='devstack@QuobyteHD#QuobyteHD',id=6d76f186-f990-48d6-861d-7b870191fb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:37Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1128de-8b68-4d91-abf2-3eb70f21ea46),volume_type_id=6d1128de-8b68-4d91-abf2-3eb70f21ea46)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a65739-84c9-4581-8038-b4c4e704fb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a65739-84c9-4581-8038-b4c4e704fb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78014261-5058-4b2e-8950-c11129a893c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78014261-5058-4b2e-8950-c11129a893c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d76f186-f990-48d6-861d-7b870191fb83', 'volume_name': 'volume-6d76f186-f990-48d6-861d-7b870191fb83', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047e3bde-1ece-49aa-b58e-05faa71ea9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047e3bde-1ece-49aa-b58e-05faa71ea9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c880763-f825-4eed-829a-3c8bb82fd5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:36 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Volume 6d76f186-f990-48d6-861d-7b870191fb83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d76f186-f990-48d6-861d-7b870191fb83', 'volume_size': 1} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4cbcbe19-f386-4d28-9fa7-028d9986e76e,created_at=2026-11-03T17:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774694935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4cbcbe19-f386-4d28-9fa7-028d9986e76e,host='devstack@QuobyteHD#QuobyteHD',id=6d76f186-f990-48d6-861d-7b870191fb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:37Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d1128de-8b68-4d91-abf2-3eb70f21ea46),volume_type_id=6d1128de-8b68-4d91-abf2-3eb70f21ea46)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Creating volume 6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:36 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:37 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 1073741824 Nov 03 18:27:37 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:37 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 1073741824" returned: 0 in 0.685s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:37 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 Nov 03 18:27:37 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:38 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c880763-f825-4eed-829a-3c8bb82fd5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d76f186-f990-48d6-861d-7b870191fb83', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d761d169-83fc-4988-97e7-a059fc8a7a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:38 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Volume volume-6d76f186-f990-48d6-861d-7b870191fb83 (6d76f186-f990-48d6-861d-7b870191fb83): created successfully Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d761d169-83fc-4988-97e7-a059fc8a7a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (abae7b44-7a9c-4b1c-a639-4d90c626e900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2deb3123-234f-490c-91c9-d4b943582c38 tempest-GroupSnapshotsTest-120082620 None] Created volume successfully. Nov 03 18:27:39 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] GroupSnapshot e9da3003-85d9-4504-8766-879b27d219c3: creating. Nov 03 18:27:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Group snapshot e9da3003-85d9-4504-8766-879b27d219c3: creating. {{(pid=86841) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 18:27:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Creating offline snapshot 160eacbb-fb0d-46ac-b56c-bb0263d6e973 of volume 6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:27:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786406a-062b-44bd-acca-3c2dc278737f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:39 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 Nov 03 18:27:39 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:40 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83" returned: 0 in 0.433s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:40 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 1G Nov 03 18:27:40 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:40 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 1G" returned: 0 in 0.484s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d76f186-f990-48d6-861d-7b870191fb83 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:40 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d76f186-f990-48d6-861d-7b870191fb83 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 Nov 03 18:27:40 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:40 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d76f186-f990-48d6-861d-7b870191fb83 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973" returned: 0 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:40 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:27:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:40 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 Nov 03 18:27:40 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:41 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973" returned: 0 in 0.326s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:41 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info Nov 03 18:27:41 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:41 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info" returned: 0 in 0.279s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:41 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:27:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:41 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info Nov 03 18:27:41 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:41 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.info" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1a624a2c-d858-42ca-85a0-6fdcf837af1f tempest-GroupSnapshotsTest-120082620 None] group_snapshot e9da3003-85d9-4504-8766-879b27d219c3: created successfully Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-160eacbb-fb0d-46ac-b56c-bb0263d6e973-971d14da-5126-4c8b-a3a2-5281fcd423cd" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-160eacbb-fb0d-46ac-b56c-bb0263d6e973-971d14da-5126-4c8b-a3a2-5281fcd423cd" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Creating volume 971d14da-5126-4c8b-a3a2-5281fcd423cd from snapshot 160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-971d14da-5126-4c8b-a3a2-5281fcd423cd" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-971d14da-5126-4c8b-a3a2-5281fcd423cd" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] snapshot: 160eacbb-fb0d-46ac-b56c-bb0263d6e973, volume: 971d14da-5126-4c8b-a3a2-5281fcd423cd, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c2928-0bc8-4ea8-8bac-0f38b28643bb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:44 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 Nov 03 18:27:44 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:44 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973" returned: 0 in 0.738s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d76f186-f990-48d6-861d-7b870191fb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af0483-c1b7-47dc-b622-562df881c2dc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:45 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 Nov 03 18:27:45 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:45 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83" returned: 0 in 0.710s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:27:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:27:45 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:27:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:45 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd Nov 03 18:27:45 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-1b6c2dbf-d7c4-4c07-a9c1-ee280fdabc2e req-262fe41d-196a-4dcf-8bb1-9f7862970035 tempest-AttachVolumeTestJSON-729153251 None] Terminate volume connection completed successfully. Nov 03 18:27:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-1b6c2dbf-d7c4-4c07-a9c1-ee280fdabc2e req-262fe41d-196a-4dcf-8bb1-9f7862970035 tempest-AttachVolumeTestJSON-729153251 None] Deleting attachment 1247ef46-0326-4125-b6c5-4f71af38bbc8. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:27:48 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Flow 'volume_create_manager' (e8887a9e-4c07-435f-b794-b52f28e529e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a3663c-1bc0-4d63-94b1-c199cf668d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a3663c-1bc0-4d63-94b1-c199cf668d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677147408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e4aa94-838a-4fa3-a949-107911f9d3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6c494eae54636934636c414d8f665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:49Z,use_quota=True,user_id='0f769e0c40b940aeb4ff7c5e9abd332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73674cbf-b2c9-4cf7-ab65-dd8ce9ce0309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73674cbf-b2c9-4cf7-ab65-dd8ce9ce0309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe31034-0121-41b9-89bf-6118d89d5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe31034-0121-41b9-89bf-6118d89d5093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e4aa94-838a-4fa3-a949-107911f9d3b6', 'volume_name': 'volume-79e4aa94-838a-4fa3-a949-107911f9d3b6', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279820bd-ff77-4a01-b67f-266a95978b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279820bd-ff77-4a01-b67f-266a95978b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf80794d-8969-42b5-b1ea-af65a4f921f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Volume 79e4aa94-838a-4fa3-a949-107911f9d3b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e4aa94-838a-4fa3-a949-107911f9d3b6', 'volume_size': 1} Nov 03 18:27:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:55 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd" returned: 0 in 9.748s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83, size 1024.00 MB, duration 9.75 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:27:55 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Converted 1024.00 MB image at 105.04 MB/s Nov 03 18:27:55 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:55 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd Nov 03 18:27:55 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:55 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd" returned: 0 in 0.402s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-971d14da-5126-4c8b-a3a2-5281fcd423cd" released by "_copy_volume_from_snapshot" :: held 11.803s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-160eacbb-fb0d-46ac-b56c-bb0263d6e973-971d14da-5126-4c8b-a3a2-5281fcd423cd" released by "_create_volume_from_snapshot" :: held 11.915s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.936s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.653s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-677147408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e4aa94-838a-4fa3-a949-107911f9d3b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a6c494eae54636934636c414d8f665',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:49Z,use_quota=True,user_id='0f769e0c40b940aeb4ff7c5e9abd332c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Creating volume 79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:55 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:55 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 1073741824 Nov 03 18:27:55 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7718b21b-3ad4-4f5f-a1cb-909390d2a04d tempest-GroupSnapshotsTest-120082620 None] Create group from source-snapshot-e9da3003-85d9-4504-8766-879b27d219c3 completed successfully. Nov 03 18:27:56 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 1073741824" returned: 0 in 0.494s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:56 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:27:56 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:56 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.478s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf80794d-8969-42b5-b1ea-af65a4f921f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e4aa94-838a-4fa3-a949-107911f9d3b6', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1972f9e1-83a4-4303-95f6-c2f9b34c21d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Volume volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 (79e4aa94-838a-4fa3-a949-107911f9d3b6): created successfully Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1972f9e1-83a4-4303-95f6-c2f9b34c21d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Flow 'volume_create_manager' (e8887a9e-4c07-435f-b794-b52f28e529e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0553ad0d-4fd3-47cb-a10f-c0461f8d41d5 tempest-VolumesActionsTest-63142371 None] Created volume successfully. Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-971d14da-5126-4c8b-a3a2-5281fcd423cd" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-971d14da-5126-4c8b-a3a2-5281fcd423cd" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f259b0b2-0ce1-4435-80c8-0a0e8096b8d8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:57 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd Nov 03 18:27:57 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Flow 'volume_create_manager' (c396f942-578b-4fdc-b951-82ef99d3ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366870d8-5641-4ace-b9d4-c2875fa0bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:57 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd" returned: 0 in 0.468s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:57 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd Nov 03 18:27:57 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366870d8-5641-4ace-b9d4-c2875fa0bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-807314463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f356c12-ce6f-4483-a0dd-35871096f051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7d1e40d8f4b5499b3e49349bf7e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:58Z,use_quota=True,user_id='7b3d8ea92a5640e39ad4bb78821c70b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5cc808-ff4d-4ce3-8baa-a39983d79af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5cc808-ff4d-4ce3-8baa-a39983d79af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1891e13a-b3a5-49c4-a2bb-22bf4f73d701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1891e13a-b3a5-49c4-a2bb-22bf4f73d701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f356c12-ce6f-4483-a0dd-35871096f051', 'volume_name': 'volume-8f356c12-ce6f-4483-a0dd-35871096f051', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06455bb8-5a1e-4845-bad7-3be5fefb9d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06455bb8-5a1e-4845-bad7-3be5fefb9d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e984590e-5306-4be2-8fc6-60626bd24f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Volume 8f356c12-ce6f-4483-a0dd-35871096f051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f356c12-ce6f-4483-a0dd-35871096f051', 'volume_size': 1} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-807314463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f356c12-ce6f-4483-a0dd-35871096f051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7d1e40d8f4b5499b3e49349bf7e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:27:58Z,use_quota=True,user_id='7b3d8ea92a5640e39ad4bb78821c70b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Creating volume 8f356c12-ce6f-4483-a0dd-35871096f051 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:27:57 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:27:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:57 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 1073741824 Nov 03 18:27:57 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:58 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-971d14da-5126-4c8b-a3a2-5281fcd423cd" returned: 0 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-971d14da-5126-4c8b-a3a2-5281fcd423cd" released by "delete_volume" :: held 0.876s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['d7fbbd8a-8942-42a3-88ce-0bccb1c67fb4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:58 devstack cinder-volume[86841]: WARNING cinder.quota [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1377809846 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1377809846, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:27:58 devstack cinder-volume[86841]: WARNING cinder.quota [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1377809846 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1377809846, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['59a085c1-535c-4080-bd40-4158cc74bfa5', '653229c1-32c0-4ce4-a0d1-013de8b81879', '568b98bd-0e78-46bc-8210-3d0e3d13b6b0', 'b774cd7b-1668-4452-bd3c-f7fc768b2d11'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:58 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:58 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] group_snapshot e9da3003-85d9-4504-8766-879b27d219c3: deleting Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] group_snapshot e9da3003-85d9-4504-8766-879b27d219c3: deleting {{(pid=86841) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 18:27:58 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 1073741824" returned: 0 in 0.744s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-6d76f186-f990-48d6-861d-7b870191fb83" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-6d76f186-f990-48d6-861d-7b870191fb83" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-160eacbb-fb0d-46ac-b56c-bb0263d6e973" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-160eacbb-fb0d-46ac-b56c-bb0263d6e973" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Deleting offline snapshot 160eacbb-fb0d-46ac-b56c-bb0263d6e973 of volume 6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:27:58 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 Nov 03 18:27:58 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] snapshot_file for this snap is: volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b0ca4-11e1-4445-afa8-1880c4148843]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:58 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:58 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 Nov 03 18:27:58 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.554s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:58 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a991a255-eb06-4dda-a828-2d73e5abfc06 tempest-GroupSnapshotsTest-120082620 None] Delete group completed successfully. Nov 03 18:27:59 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051" returned: 0 in 0.368s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e984590e-5306-4be2-8fc6-60626bd24f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f356c12-ce6f-4483-a0dd-35871096f051', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2aaaaf-0c50-4102-9c93-f11908906dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:27:59 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Volume volume-8f356c12-ce6f-4483-a0dd-35871096f051 (8f356c12-ce6f-4483-a0dd-35871096f051): created successfully Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2aaaaf-0c50-4102-9c93-f11908906dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Flow 'volume_create_manager' (c396f942-578b-4fdc-b951-82ef99d3ca76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:27:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d7d229a4-6dc4-4d7a-b84c-b22ce5bee1de tempest-VolumesTransfersTest-953755187 None] Created volume successfully. Nov 03 18:27:59 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973" returned: 0 in 0.458s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d76f186-f990-48d6-861d-7b870191fb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ed386-a614-41b2-bd01-68b3912ee26b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:59 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 Nov 03 18:27:59 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:27:59 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:27:59 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:27:59 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.399s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:27:59 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83" returned: 0 in 0.732s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:27:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:00 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 Nov 03 18:28:00 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:00 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973" returned: 0 in 0.487s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:00 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973 Nov 03 18:28:00 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a08ebcfa-1b16-4c19-adc9-f7c08f494525 tempest-VolumesTransfersTest-1809962841 None] Transfer volume completed successfully. Nov 03 18:28:00 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83.160eacbb-fb0d-46ac-b56c-bb0263d6e973" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-160eacbb-fb0d-46ac-b56c-bb0263d6e973" released by "_delete_snapshot" :: held 2.181s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-6d76f186-f990-48d6-861d-7b870191fb83" released by "delete_snapshot" :: held 2.240s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:00 devstack cinder-volume[86841]: WARNING cinder.quota [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1377809846 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1377809846, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['ba0d60b6-34fc-4597-9fc5-60d41c71f3e0', '81265efa-a0d1-4369-bf5b-a59be3ab14b5', '31a595e0-a14d-4205-9376-575ef3d9d423', 'af5fccca-cdb3-41e4-aa4a-41f31ddbf64f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ba2af984-8ca5-4ac1-8f54-d04958293cc5 tempest-GroupSnapshotsTest-120082620 None] group_snapshot e9da3003-85d9-4504-8766-879b27d219c3: deleted successfully Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Acquiring lock "cinder-8f356c12-ce6f-4483-a0dd-35871096f051-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Lock "cinder-8f356c12-ce6f-4483-a0dd-35871096f051-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Acquiring lock "cinder-quobyte-8f356c12-ce6f-4483-a0dd-35871096f051" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Lock "cinder-quobyte-8f356c12-ce6f-4483-a0dd-35871096f051" acquired by "delete_volume" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6614173c-6d58-4921-917b-07a8deb8d4a1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:01 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 Nov 03 18:28:01 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:02 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051" returned: 0 in 0.599s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:02 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051 Nov 03 18:28:02 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-6d76f186-f990-48d6-861d-7b870191fb83" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-6d76f186-f990-48d6-861d-7b870191fb83" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3321e6c4-1afa-4e02-a932-b422554f6f99]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:02 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 Nov 03 18:28:02 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:02 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f356c12-ce6f-4483-a0dd-35871096f051" returned: 0 in 0.622s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Lock "cinder-quobyte-8f356c12-ce6f-4483-a0dd-35871096f051" released by "delete_volume" :: held 1.355s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Created reservations ['9b5a24a7-42fb-493b-a84a-57113df09942', 'bf670695-9abc-4226-a25d-d520c7a768e8', 'b7141b6a-94d7-420e-9577-1ad715a5a8f8', '1faac916-3971-4161-ad3a-74f20cbb98d2'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:03 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83" returned: 0 in 0.661s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:03 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83 Nov 03 18:28:03 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:03 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:28:03 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:03 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.320s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:28:03 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d76f186-f990-48d6-861d-7b870191fb83" returned: 0 in 0.366s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Deleted volume successfully. Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-6d76f186-f990-48d6-861d-7b870191fb83" released by "delete_volume" :: held 1.134s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58ef0d87-0f15-48be-995b-cfa5d85c0fbd tempest-VolumesTransfersTest-847707986 None] Lock "cinder-8f356c12-ce6f-4483-a0dd-35871096f051-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Created reservations ['82929570-289d-4ace-92e5-f4ed4f453dd3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:03 devstack cinder-volume[86841]: WARNING cinder.db.api [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1377809846'] Nov 03 18:28:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Created reservations ['3f4fd7dd-bee4-4e9a-ba4c-d45c517e09fc', '40d4c0f2-e4cb-43d5-9c8d-9645c076113e', '3960d97d-be9a-4c58-b2c9-4fd14cedf606', '5448f882-c9ad-4973-9665-f98960d10041'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:04 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:28:04 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:28:05 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Flow 'volume_create_manager' (d6345ec9-9221-4bbe-959e-37ad970e5315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d407a1ba-3134-4920-b986-b08bc69d2e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.911s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:28:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-eae01f58-5c05-421a-8fbf-347898121d6f tempest-GroupSnapshotsTest-120082620 None] Delete group completed successfully. Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d407a1ba-3134-4920-b986-b08bc69d2e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-520705626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3334721-f95d-411a-b8a4-3002ad28d0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7d1e40d8f4b5499b3e49349bf7e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:05Z,use_quota=True,user_id='7b3d8ea92a5640e39ad4bb78821c70b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de747fa-2dbf-4940-86bb-229a57ba00fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de747fa-2dbf-4940-86bb-229a57ba00fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5cffa6-7ba7-43bc-8bf0-7c3c5be26cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5cffa6-7ba7-43bc-8bf0-7c3c5be26cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3334721-f95d-411a-b8a4-3002ad28d0db', 'volume_name': 'volume-b3334721-f95d-411a-b8a4-3002ad28d0db', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36119ac-164a-4ca5-ae99-37f20178fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36119ac-164a-4ca5-ae99-37f20178fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46657320-94f3-4055-9ee1-9fc5bccbc0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Volume b3334721-f95d-411a-b8a4-3002ad28d0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3334721-f95d-411a-b8a4-3002ad28d0db', 'volume_size': 1} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-520705626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3334721-f95d-411a-b8a4-3002ad28d0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7d1e40d8f4b5499b3e49349bf7e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:05Z,use_quota=True,user_id='7b3d8ea92a5640e39ad4bb78821c70b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Creating volume b3334721-f95d-411a-b8a4-3002ad28d0db {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:28:05 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:28:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:05 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db 1073741824 Nov 03 18:28:05 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:06 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db 1073741824" returned: 0 in 0.945s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1a4113fa-7945-4692-bb5d-1da4122debc7 tempest-GroupSnapshotsTest-120082620 None] Group tempest-GroupSnapshotsTest-Group-509357266: creating Nov 03 18:28:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1a4113fa-7945-4692-bb5d-1da4122debc7 tempest-GroupSnapshotsTest-120082620 None] Group tempest-GroupSnapshotsTest-Group-509357266: created successfully Nov 03 18:28:06 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db Nov 03 18:28:06 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1a4113fa-7945-4692-bb5d-1da4122debc7 tempest-GroupSnapshotsTest-120082620 None] Create group completed successfully. Nov 03 18:28:07 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db" returned: 0 in 0.769s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46657320-94f3-4055-9ee1-9fc5bccbc0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3334721-f95d-411a-b8a4-3002ad28d0db', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe28421-3025-43df-b21a-38b40c55355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:07 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Volume volume-b3334721-f95d-411a-b8a4-3002ad28d0db (b3334721-f95d-411a-b8a4-3002ad28d0db): created successfully Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe28421-3025-43df-b21a-38b40c55355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Flow 'volume_create_manager' (d6345ec9-9221-4bbe-959e-37ad970e5315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c062bff4-7a8d-4dfc-8676-26586d8c11e0 tempest-VolumesTransfersTest-953755187 None] Created volume successfully. Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (ae75ef78-f72f-4207-8976-e21171078faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015acf72-f62b-46bd-9bce-483612573c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015acf72-f62b-46bd-9bce-483612573c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796821454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=153ca806-1001-4afd-b1fa-a5cf6ed851ce,host='devstack@QuobyteHD#QuobyteHD',id=22b050cc-a302-4075-824a-cc4fe9b3fbac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:08Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57b69b1a-e0f4-42be-8bdb-360df58050c9),volume_type_id=57b69b1a-e0f4-42be-8bdb-360df58050c9)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5e97b5-fbf4-48c9-a731-ff783cdeb89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5e97b5-fbf4-48c9-a731-ff783cdeb89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9539f77e-2303-4875-95b7-c3a671675168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9539f77e-2303-4875-95b7-c3a671675168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b050cc-a302-4075-824a-cc4fe9b3fbac', 'volume_name': 'volume-22b050cc-a302-4075-824a-cc4fe9b3fbac', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89579b49-a7f2-4734-ad4e-624ea0c089b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89579b49-a7f2-4734-ad4e-624ea0c089b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c9c72b-96c9-4148-ab62-8e75f263cb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:08 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Volume 22b050cc-a302-4075-824a-cc4fe9b3fbac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b050cc-a302-4075-824a-cc4fe9b3fbac', 'volume_size': 1} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=153ca806-1001-4afd-b1fa-a5cf6ed851ce,created_at=2026-11-03T17:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796821454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=153ca806-1001-4afd-b1fa-a5cf6ed851ce,host='devstack@QuobyteHD#QuobyteHD',id=22b050cc-a302-4075-824a-cc4fe9b3fbac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:08Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57b69b1a-e0f4-42be-8bdb-360df58050c9),volume_type_id=57b69b1a-e0f4-42be-8bdb-360df58050c9)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Creating volume 22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:28:08 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:08 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac 1073741824 Nov 03 18:28:08 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Acquiring lock "cinder-b3334721-f95d-411a-b8a4-3002ad28d0db-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Lock "cinder-b3334721-f95d-411a-b8a4-3002ad28d0db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Acquiring lock "cinder-quobyte-b3334721-f95d-411a-b8a4-3002ad28d0db" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Lock "cinder-quobyte-b3334721-f95d-411a-b8a4-3002ad28d0db" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce6c866-3acd-4ed9-a412-9584e6388646]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:08 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac 1073741824" returned: 0 in 0.604s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:09 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac Nov 03 18:28:09 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:09 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db Nov 03 18:28:09 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:09 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac" returned: 0 in 0.283s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c9c72b-96c9-4148-ab62-8e75f263cb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b050cc-a302-4075-824a-cc4fe9b3fbac', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:09 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9e0fe7-3b66-41f5-8078-00c0a212350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db" returned: 0 in 0.385s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:09 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Volume volume-22b050cc-a302-4075-824a-cc4fe9b3fbac (22b050cc-a302-4075-824a-cc4fe9b3fbac): created successfully Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9e0fe7-3b66-41f5-8078-00c0a212350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:09 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db Nov 03 18:28:09 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (ae75ef78-f72f-4207-8976-e21171078faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c356b616-94c6-4d6d-b2b7-4a4667d9482c tempest-GroupSnapshotsTest-120082620 None] Created volume successfully. Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-553b037d-ccd2-4f2b-b7ea-6e851e96e5c9 tempest-VolumesActionsTest-63142371 None] Acquiring lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6" by "attach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-553b037d-ccd2-4f2b-b7ea-6e851e96e5c9 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6" acquired by "attach_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:09 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b3334721-f95d-411a-b8a4-3002ad28d0db" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Lock "cinder-quobyte-b3334721-f95d-411a-b8a4-3002ad28d0db" released by "delete_volume" :: held 0.787s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-553b037d-ccd2-4f2b-b7ea-6e851e96e5c9 tempest-VolumesActionsTest-63142371 None] Attaching volume 79e4aa94-838a-4fa3-a949-107911f9d3b6 to instance 7fe949eb-a0b2-44f1-9cce-f107b1cc01c8 at mountpoint /dev/vdb on host None. Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Created reservations ['c20a6973-c220-4044-b1d3-9dd15d0efecf', '285037c6-0e79-4109-ac4c-92e18d1f6ae8', '6d84716c-3c59-4353-a1d8-4ad200e5dce6', '3f99ef1e-bc5c-46c0-8c0c-f8fda40c50a4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-553b037d-ccd2-4f2b-b7ea-6e851e96e5c9 tempest-VolumesActionsTest-63142371 None] Attach volume completed successfully. Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-553b037d-ccd2-4f2b-b7ea-6e851e96e5c9 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6" released by "attach_volume" :: held 0.170s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:09 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:28:09 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8cb392e5-c26e-4e42-8a95-55d1fb4b9453 tempest-VolumesActionsTest-63142371 None] Acquiring lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-detach_volume" by "detach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8cb392e5-c26e-4e42-8a95-55d1fb4b9453 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8cb392e5-c26e-4e42-8a95-55d1fb4b9453 tempest-VolumesActionsTest-63142371 None] Detaching volume 79e4aa94-838a-4fa3-a949-107911f9d3b6 from instance 7fe949eb-a0b2-44f1-9cce-f107b1cc01c8. Nov 03 18:28:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8cb392e5-c26e-4e42-8a95-55d1fb4b9453 tempest-VolumesActionsTest-63142371 None] Detach volume completed successfully. Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8cb392e5-c26e-4e42-8a95-55d1fb4b9453 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:28:10 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (7c12dbef-310a-4953-9b30-cfe91792c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498c67db-4e25-4cc2-97c2-0d5cc41fbde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.580s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (498c67db-4e25-4cc2-97c2-0d5cc41fbde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-110672591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=153ca806-1001-4afd-b1fa-a5cf6ed851ce,host='devstack@QuobyteHD#QuobyteHD',id=57a601b7-999e-454b-83e8-c47541c276c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:10Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57b69b1a-e0f4-42be-8bdb-360df58050c9),volume_type_id=57b69b1a-e0f4-42be-8bdb-360df58050c9)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657e6815-ffbb-4b64-b084-697dcb6a98d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657e6815-ffbb-4b64-b084-697dcb6a98d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02316a93-b0ae-4a87-b499-f5535b2c00cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02316a93-b0ae-4a87-b499-f5535b2c00cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a601b7-999e-454b-83e8-c47541c276c1', 'volume_name': 'volume-57a601b7-999e-454b-83e8-c47541c276c1', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8778560-332d-4af3-a9c8-a2bbe7c7487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8778560-332d-4af3-a9c8-a2bbe7c7487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01df4379-7924-4251-b09c-131003176dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Volume 57a601b7-999e-454b-83e8-c47541c276c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a601b7-999e-454b-83e8-c47541c276c1', 'volume_size': 1} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=153ca806-1001-4afd-b1fa-a5cf6ed851ce,created_at=2026-11-03T17:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-110672591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=153ca806-1001-4afd-b1fa-a5cf6ed851ce,host='devstack@QuobyteHD#QuobyteHD',id=57a601b7-999e-454b-83e8-c47541c276c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:10Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57b69b1a-e0f4-42be-8bdb-360df58050c9),volume_type_id=57b69b1a-e0f4-42be-8bdb-360df58050c9)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Creating volume 57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:28:10 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Deleted volume successfully. Nov 03 18:28:10 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 1073741824 Nov 03 18:28:10 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b2809c78-b539-4b95-bc4e-a0747f4d25b9 tempest-VolumesTransfersTest-847707986 None] Lock "cinder-b3334721-f95d-411a-b8a4-3002ad28d0db-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:11 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 1073741824" returned: 0 in 0.685s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:11 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 Nov 03 18:28:11 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:11 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1" returned: 0 in 0.289s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01df4379-7924-4251-b09c-131003176dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a601b7-999e-454b-83e8-c47541c276c1', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ef47f6-5c77-4d0c-be2f-afbfec04e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Volume volume-57a601b7-999e-454b-83e8-c47541c276c1 (57a601b7-999e-454b-83e8-c47541c276c1): created successfully Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ef47f6-5c77-4d0c-be2f-afbfec04e976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (7c12dbef-310a-4953-9b30-cfe91792c294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7a5a819c-38ca-4fd7-ae16-447c82cec506 tempest-GroupSnapshotsTest-120082620 None] Created volume successfully. Nov 03 18:28:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-703130b3-d755-4dc3-9cd1-e56757c2f63c tempest-GroupSnapshotsTest-120082620 None] Update group completed successfully. Nov 03 18:28:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3d9f3dbd-2381-4ac6-aab8-f252515f84fc tempest-GroupSnapshotsTest-120082620 None] Update group completed successfully. Nov 03 18:28:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b003f3d8-e52b-4014-9086-331668378886 tempest-GroupSnapshotsTest-120082620 None] Update group completed successfully. Nov 03 18:28:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-06062304-0c9f-4026-a84c-eb91f6c46a09 tempest-GroupSnapshotsTest-120082620 None] Update group completed successfully. Nov 03 18:28:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] GroupSnapshot 244a4f33-7cfd-4963-97fc-82147ad41386: creating. Nov 03 18:28:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Group snapshot 244a4f33-7cfd-4963-97fc-82147ad41386: creating. {{(pid=86841) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 18:28:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Creating offline snapshot f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 of volume 22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:28:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f1831-0374-4b05-89c9-d5e8f3cc1c8a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:18 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac Nov 03 18:28:18 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:19 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac" returned: 0 in 0.606s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:19 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 1G Nov 03 18:28:19 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:19 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 1G" returned: 0 in 0.866s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b050cc-a302-4075-824a-cc4fe9b3fbac -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:20 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b050cc-a302-4075-824a-cc4fe9b3fbac -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 Nov 03 18:28:20 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:20 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22b050cc-a302-4075-824a-cc4fe9b3fbac -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" returned: 0 in 0.808s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:20 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:28:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:20 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 Nov 03 18:28:20 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:21 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" returned: 0 in 0.333s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=100,cinder:UPDATE=122,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=103,cinder:SELECT=104,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:28:21 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info Nov 03 18:28:21 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Flow 'volume_create_manager' (89c65c21-4076-4bba-9cb1-a926413c21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6377539b-0947-4453-8431-69662fea0d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6377539b-0947-4453-8431-69662fea0d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-557787502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afeae468-22a7-4404-a09c-a8bfc236e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d54aec07e34eb48fe6c1da8abaad80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:21Z,use_quota=True,user_id='536c28446ae648a1bac3cda327bf82da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0baf57-08b5-4870-ae44-a99f42d9821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0baf57-08b5-4870-ae44-a99f42d9821e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014779bc-30f7-4fa8-b8ce-5af9e3bbc418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014779bc-30f7-4fa8-b8ce-5af9e3bbc418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afeae468-22a7-4404-a09c-a8bfc236e7d7', 'volume_name': 'volume-afeae468-22a7-4404-a09c-a8bfc236e7d7', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea757912-3b24-4d85-a935-3034b8e345c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea757912-3b24-4d85-a935-3034b8e345c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a722f78-30fb-400a-bb90-5574f9762a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:21 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Volume afeae468-22a7-4404-a09c-a8bfc236e7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afeae468-22a7-4404-a09c-a8bfc236e7d7', 'volume_size': 1} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:21 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info" returned: 0 in 0.372s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:21 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:21 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info Nov 03 18:28:21 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:21 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.info" returned: 0 in 0.311s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.456s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Creating offline snapshot fcd8fa3e-102f-4be1-9275-4d40259cec41 of volume 57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8c7696-8820-4c78-a4ca-d9f4f91860e4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:22 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 Nov 03 18:28:22 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:22 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1" returned: 0 in 0.444s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:22 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 1G Nov 03 18:28:22 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-da44fb24-edc0-4d1f-b9f8-94a32820c6b8 tempest-VolumesActionsTest-63142371 None] Acquiring lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6" by "attach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-da44fb24-edc0-4d1f-b9f8-94a32820c6b8 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6" acquired by "attach_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:23 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 1G" returned: 0 in 0.664s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57a601b7-999e-454b-83e8-c47541c276c1 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-da44fb24-edc0-4d1f-b9f8-94a32820c6b8 tempest-VolumesActionsTest-63142371 None] Attaching volume 79e4aa94-838a-4fa3-a949-107911f9d3b6 to instance 3683ac67-2b97-415c-9f3b-29389d39a0ac at mountpoint /dev/vdb on host None. Nov 03 18:28:23 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57a601b7-999e-454b-83e8-c47541c276c1 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 Nov 03 18:28:23 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-da44fb24-edc0-4d1f-b9f8-94a32820c6b8 tempest-VolumesActionsTest-63142371 None] Attach volume completed successfully. Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-da44fb24-edc0-4d1f-b9f8-94a32820c6b8 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6" released by "attach_volume" :: held 0.173s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:23 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57a601b7-999e-454b-83e8-c47541c276c1 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41" returned: 0 in 0.411s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:23 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:23 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 Nov 03 18:28:23 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-481b70aa-72bd-400d-9222-a42904192221 tempest-VolumesActionsTest-63142371 None] Acquiring lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-detach_volume" by "detach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-481b70aa-72bd-400d-9222-a42904192221 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-481b70aa-72bd-400d-9222-a42904192221 tempest-VolumesActionsTest-63142371 None] Detaching volume 79e4aa94-838a-4fa3-a949-107911f9d3b6 from instance 3683ac67-2b97-415c-9f3b-29389d39a0ac. Nov 03 18:28:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-481b70aa-72bd-400d-9222-a42904192221 tempest-VolumesActionsTest-63142371 None] Detach volume completed successfully. Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-481b70aa-72bd-400d-9222-a42904192221 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:23 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41" returned: 0 in 0.493s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:24 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info Nov 03 18:28:24 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:24 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info" returned: 0 in 0.358s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:24 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:24 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info Nov 03 18:28:24 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:24 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.info" returned: 0 in 0.362s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.451s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-557787502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afeae468-22a7-4404-a09c-a8bfc236e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d54aec07e34eb48fe6c1da8abaad80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:21Z,use_quota=True,user_id='536c28446ae648a1bac3cda327bf82da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Creating volume afeae468-22a7-4404-a09c-a8bfc236e7d7 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:28:24 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:28:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:24 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 1073741824 Nov 03 18:28:24 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-885802a5-e74f-4696-8d4c-a13361aaa7d8 tempest-GroupSnapshotsTest-120082620 None] group_snapshot 244a4f33-7cfd-4963-97fc-82147ad41386: created successfully Nov 03 18:28:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] group_snapshot 244a4f33-7cfd-4963-97fc-82147ad41386: deleting Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] group_snapshot 244a4f33-7cfd-4963-97fc-82147ad41386: deleting {{(pid=86841) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-22b050cc-a302-4075-824a-cc4fe9b3fbac" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-22b050cc-a302-4075-824a-cc4fe9b3fbac" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Deleting offline snapshot f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 of volume 22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:28:25 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] snapshot_file for this snap is: volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 1073741824" returned: 0 in 0.656s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d9a7f5-f5b8-4e08-86e7-e8ad6725b212]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:25 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 Nov 03 18:28:25 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:25 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 Nov 03 18:28:25 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:25 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7" returned: 0 in 0.414s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a722f78-30fb-400a-bb90-5574f9762a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afeae468-22a7-4404-a09c-a8bfc236e7d7', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9030f881-3d4e-4609-8027-a0a4ed82a7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Volume volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 (afeae468-22a7-4404-a09c-a8bfc236e7d7): created successfully Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9030f881-3d4e-4609-8027-a0a4ed82a7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Flow 'volume_create_manager' (89c65c21-4076-4bba-9cb1-a926413c21c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a0fae474-57c4-4ed1-8fee-eca8041e8dc4 tempest-VolumesTransfersV357Test-139566171 None] Created volume successfully. Nov 03 18:28:26 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" returned: 0 in 0.649s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22b050cc-a302-4075-824a-cc4fe9b3fbac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba11ed7f-0135-4805-a79d-368eb3f69a79]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:26 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac Nov 03 18:28:26 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:26 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac" returned: 0 in 0.440s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:26 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 Nov 03 18:28:26 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:27 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" returned: 0 in 0.433s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:27 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7 Nov 03 18:28:27 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:27 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac.f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" returned: 0 in 0.457s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-f13a5ec6-b9e9-466a-9dcf-1d16d0fee8c7" released by "_delete_snapshot" :: held 2.151s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e02eeccb-fd5d-4770-9ca3-6a467662959e tempest-VolumesTransfersV357Test-790808941 None] Transfer volume completed successfully. Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-22b050cc-a302-4075-824a-cc4fe9b3fbac" released by "delete_snapshot" :: held 2.192s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-57a601b7-999e-454b-83e8-c47541c276c1" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-57a601b7-999e-454b-83e8-c47541c276c1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-fcd8fa3e-102f-4be1-9275-4d40259cec41" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-fcd8fa3e-102f-4be1-9275-4d40259cec41" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Deleting offline snapshot fcd8fa3e-102f-4be1-9275-4d40259cec41 of volume 57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] snapshot_file for this snap is: volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc79b3c7-cba9-4307-8ab9-844992e3788d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:27 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 Nov 03 18:28:27 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:28 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Acquiring lock "cinder-afeae468-22a7-4404-a09c-a8bfc236e7d7-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41" returned: 0 in 0.619s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57a601b7-999e-454b-83e8-c47541c276c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-afeae468-22a7-4404-a09c-a8bfc236e7d7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac91049-c233-4fe3-ab52-8cabfd2e02fe]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Acquiring lock "cinder-quobyte-afeae468-22a7-4404-a09c-a8bfc236e7d7" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-quobyte-afeae468-22a7-4404-a09c-a8bfc236e7d7" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8dd75a-3028-41e3-ad99-e2f30ded2935]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:28 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 Nov 03 18:28:28 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:28 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 Nov 03 18:28:28 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:28 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1" returned: 0 in 0.601s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:29 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 Nov 03 18:28:29 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:29 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7" returned: 0 in 0.570s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:29 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7 Nov 03 18:28:29 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:29 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-afeae468-22a7-4404-a09c-a8bfc236e7d7" returned: 0 in 0.368s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-quobyte-afeae468-22a7-4404-a09c-a8bfc236e7d7" released by "delete_volume" :: held 1.020s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:29 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d0fc6b-ad61-4cea-9002-31496c613fec]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41" returned: 0 in 0.539s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:29 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41 Nov 03 18:28:29 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Created reservations ['40a239a2-135c-48e0-a92b-c6477f377b04', '649a0281-660f-4932-a8ce-4694568ca601', '8c2eaa8c-0ca3-4f59-b222-e5d90d220bc3', '716cfe4a-9aec-45f7-87b7-096bf3f9c3f3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:29 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:28:29 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:29 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:28:29 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:29 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1.fcd8fa3e-102f-4be1-9275-4d40259cec41" returned: 0 in 0.438s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-fcd8fa3e-102f-4be1-9275-4d40259cec41" released by "_delete_snapshot" :: held 2.385s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:30 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.534s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-57a601b7-999e-454b-83e8-c47541c276c1" released by "delete_snapshot" :: held 2.430s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a5d2dd-4cae-4d9a-9a9e-d3ed1d84b094]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:30 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.402s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:28:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Deleted volume successfully. Nov 03 18:28:30 devstack cinder-volume[86841]: WARNING cinder.quota [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1206144328 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1206144328, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:28:30 devstack cinder-volume[86841]: WARNING cinder.quota [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1206144328 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1206144328, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cde38873-3f3a-41f0-80c7-13d409aa6e26 tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-afeae468-22a7-4404-a09c-a8bfc236e7d7-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:30 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:28:30 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['3bd6caaf-c8d6-418e-9b9d-ec17647691a6', '3878fec1-ac37-4552-896f-e001e8d12a07', '89f300ec-120b-4d92-bd79-65c96535a138', '5a38858a-a316-4384-92e0-7d85e82c4272'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['81ac7ffc-f0b7-4843-9a06-64637c5322d4', '6eb4e057-3ea1-4dc5-85da-09d82348db85', '406c96b4-47f5-4d9a-acdb-e0f3d6cfd41f', 'cd5ab78a-873b-4e06-bb57-e389993625b9'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-14d8f75a-2ee1-4bf2-b682-1b24c89747e3 tempest-GroupSnapshotsTest-120082620 None] group_snapshot 244a4f33-7cfd-4963-97fc-82147ad41386: deleted successfully Nov 03 18:28:30 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.493s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.de2192f2-a4df-4669-952a-4ecc849e22c2z8ohhllx.img {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:30 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.de2192f2-a4df-4669-952a-4ecc849e22c2z8ohhllx.img Nov 03 18:28:30 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Flow 'volume_create_manager' (dbe0341c-2c3e-4444-9780-a30e8b7a2476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e44d8e3-bc77-4101-b563-d3740e752e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e44d8e3-bc77-4101-b563-d3740e752e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1507770616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ea2e9e-9103-4d61-bd66-8795d4a1f9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d54aec07e34eb48fe6c1da8abaad80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:31Z,use_quota=True,user_id='536c28446ae648a1bac3cda327bf82da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dc1400-a1cf-4053-bb11-6719f8475cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70dc1400-a1cf-4053-bb11-6719f8475cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abee4d47-08aa-47a6-aab1-3e48d3117414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abee4d47-08aa-47a6-aab1-3e48d3117414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ea2e9e-9103-4d61-bd66-8795d4a1f9ab', 'volume_name': 'volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66133530-60f3-4bf7-99c8-048d4129305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66133530-60f3-4bf7-99c8-048d4129305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97daf36f-4de1-488e-96fe-6303daa40552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:31 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Volume 64ea2e9e-9103-4d61-bd66-8795d4a1f9ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab', 'volume_size': 1} Nov 03 18:28:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-22b050cc-a302-4075-824a-cc4fe9b3fbac" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-22b050cc-a302-4075-824a-cc4fe9b3fbac" acquired by "delete_volume" :: waited 0.046s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:32 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f23bea4-565e-40c3-8bf5-dce5523d205f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:32 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac Nov 03 18:28:32 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:32 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac" returned: 0 in 0.627s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:32 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac Nov 03 18:28:32 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:33 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-22b050cc-a302-4075-824a-cc4fe9b3fbac" returned: 0 in 0.366s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-22b050cc-a302-4075-824a-cc4fe9b3fbac" released by "delete_volume" :: held 1.179s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-57a601b7-999e-454b-83e8-c47541c276c1" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:28:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-57a601b7-999e-454b-83e8-c47541c276c1" acquired by "delete_volume" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:28:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b21d59-1d51-4cf6-829f-e1a2955f6bbc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:33 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 Nov 03 18:28:33 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:34 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1" returned: 0 in 1.071s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:34 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1 Nov 03 18:28:34 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:35 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-57a601b7-999e-454b-83e8-c47541c276c1" returned: 0 in 0.940s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-57a601b7-999e-454b-83e8-c47541c276c1" released by "delete_volume" :: held 2.219s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:28:35 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['60260e35-385f-4aa7-a3a8-9e035d7431be'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:35 devstack cinder-volume[86841]: WARNING cinder.quota [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1206144328 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1206144328, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:28:35 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['ec66bcd2-ab5b-4f11-9b3c-7845f96eac4b', '6b65fc77-32ff-44c6-bae3-de8be47ab63c', '767b69dd-9751-4cb2-875f-0eec696e9846', '9867cc5b-cb6c-47d6-a5aa-a75c1f8611db'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['d888e30a-d6ed-4602-8acf-09a9d8eb9e7d', '1c24bf10-a34e-4c9b-82c2-4579e40fe392', '12b30b21-c76a-4c1b-a4c0-917a425e1987', '462fda2c-4ca7-4b48-82a2-89cea20ed274'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:36 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:28:36 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:37 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.920s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:28:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ff89c1ae-f515-469f-b0f5-cf51026fa1a7 tempest-GroupSnapshotsTest-120082620 None] Delete group completed successfully. Nov 03 18:28:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-aaca630e-0fb2-4380-8667-b3f8c3246a40 tempest-GroupSnapshotsTest-120082620 None] Group tempest-GroupSnapshotsTest-Group-1071690748: creating Nov 03 18:28:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-aaca630e-0fb2-4380-8667-b3f8c3246a40 tempest-GroupSnapshotsTest-120082620 None] Group tempest-GroupSnapshotsTest-Group-1071690748: created successfully Nov 03 18:28:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-aaca630e-0fb2-4380-8667-b3f8c3246a40 tempest-GroupSnapshotsTest-120082620 None] Create group completed successfully. Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (2139b66b-6f33-45dd-bc03-623e46143f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb968174-e100-4db0-ae51-31cff3647f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb968174-e100-4db0-ae51-31cff3647f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1069518243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=481e0f1f-92fb-43c0-ab51-e266ec371e19,host='devstack@QuobyteHD#QuobyteHD',id=14f0be7e-4cf6-45b3-9903-266504048511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:40Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e7450f6-5302-4073-8b3d-dfef06f165ea),volume_type_id=3e7450f6-5302-4073-8b3d-dfef06f165ea)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe98b12-bcfc-4454-8e7a-198446f98239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe98b12-bcfc-4454-8e7a-198446f98239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab1113b-c804-494f-8dc0-b7c5e2b6b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab1113b-c804-494f-8dc0-b7c5e2b6b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f0be7e-4cf6-45b3-9903-266504048511', 'volume_name': 'volume-14f0be7e-4cf6-45b3-9903-266504048511', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a484254-43fd-4cf9-b30e-02591d22ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a484254-43fd-4cf9-b30e-02591d22ee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bfe2d1-1514-47dd-b5a2-f523bf229727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:28:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Volume 14f0be7e-4cf6-45b3-9903-266504048511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f0be7e-4cf6-45b3-9903-266504048511', 'volume_size': 1} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:40 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.de2192f2-a4df-4669-952a-4ecc849e22c2z8ohhllx.img" returned: 0 in 10.298s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e427e61-086f-452b-90c5-36b7ec4bd498]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:28:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:41 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:28:41 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:41 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.669s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:41 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6, size 1024.00 MB, duration 10.30 sec, destination /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.de2192f2-a4df-4669-952a-4ecc849e22c2z8ohhllx.img {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:28:41 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Converted 1024.00 MB image at 99.42 MB/s Nov 03 18:28:41 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] de2192f2-a4df-4669-952a-4ecc849e22c2 was raw, no need to convert to raw {{(pid=86841) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 18:28:51 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=42,cinder:INSERT=15,cinder:UPDATE=53,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:28:51 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=57,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:28:59 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:28:59 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:28:59 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.283s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:28:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.467s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Uploaded volume to glance image-id: de2192f2-a4df-4669-952a-4ecc849e22c2. {{(pid=86841) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.237s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1507770616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ea2e9e-9103-4d61-bd66-8795d4a1f9ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d54aec07e34eb48fe6c1da8abaad80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:31Z,use_quota=True,user_id='536c28446ae648a1bac3cda327bf82da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Creating volume 64ea2e9e-9103-4d61-bd66-8795d4a1f9ab {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:29:00 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:29:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:00 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab 1073741824 Nov 03 18:29:00 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2b6a6242-7ef2-4d3f-ba39-76cac90d9f78 tempest-VolumesActionsTest-63142371 None] Copy volume to image completed successfully. Nov 03 18:29:01 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab 1073741824" returned: 0 in 0.447s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:01 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab Nov 03 18:29:01 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:01 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab" returned: 0 in 0.255s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.118s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=481e0f1f-92fb-43c0-ab51-e266ec371e19,created_at=2026-11-03T17:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1069518243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=481e0f1f-92fb-43c0-ab51-e266ec371e19,host='devstack@QuobyteHD#QuobyteHD',id=14f0be7e-4cf6-45b3-9903-266504048511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6b61b1a6c934b178d7e7447ed9d9580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:28:40Z,use_quota=True,user_id='eeb907ca8ad24e39a7ec4096e8b7e3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e7450f6-5302-4073-8b3d-dfef06f165ea),volume_type_id=3e7450f6-5302-4073-8b3d-dfef06f165ea)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Creating volume 14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:29:01 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97daf36f-4de1-488e-96fe-6303daa40552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:01 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 1073741824 Nov 03 18:29:01 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1778f09-1eae-43f2-97f0-02fd62ef57d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:01 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Volume volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab (64ea2e9e-9103-4d61-bd66-8795d4a1f9ab): created successfully Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1778f09-1eae-43f2-97f0-02fd62ef57d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Flow 'volume_create_manager' (dbe0341c-2c3e-4444-9780-a30e8b7a2476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-76acb361-fb14-412c-ae06-9ecfdc299629 tempest-VolumesTransfersV357Test-139566171 None] Created volume successfully. Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Flow 'volume_create_manager' (f0b56be5-66c7-4714-95d5-b481c7b6aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c726cd-ac50-4332-bd92-3b10d3089fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c726cd-ac50-4332-bd92-3b10d3089fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-634950237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639df4d5-74e3-424c-85a4-5b2e545f366f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88ab5604ab4a528222c6b19e1c1291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:02Z,use_quota=True,user_id='81d8d2cdf89340a9b7d92c167fdb397b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3aa672-a0d7-4206-80d0-9a0df1c05f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3aa672-a0d7-4206-80d0-9a0df1c05f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d0b7a-50ea-4a69-baed-f3c4347618ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d0b7a-50ea-4a69-baed-f3c4347618ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639df4d5-74e3-424c-85a4-5b2e545f366f', 'volume_name': 'volume-639df4d5-74e3-424c-85a4-5b2e545f366f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a33b41d-a245-4f7f-930c-e32d826b2ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a33b41d-a245-4f7f-930c-e32d826b2ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2205fefd-9fa2-456b-9bae-420f908711ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:01 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Volume 639df4d5-74e3-424c-85a4-5b2e545f366f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639df4d5-74e3-424c-85a4-5b2e545f366f', 'volume_size': 1} Nov 03 18:29:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:02 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 1073741824" returned: 0 in 0.486s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:02 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 Nov 03 18:29:02 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:02 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-634950237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639df4d5-74e3-424c-85a4-5b2e545f366f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88ab5604ab4a528222c6b19e1c1291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:02Z,use_quota=True,user_id='81d8d2cdf89340a9b7d92c167fdb397b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Creating volume 639df4d5-74e3-424c-85a4-5b2e545f366f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:29:02 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:02 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f 1073741824 Nov 03 18:29:02 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bfe2d1-1514-47dd-b5a2-f523bf229727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f0be7e-4cf6-45b3-9903-266504048511', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c43d18-5bc7-4dfd-98ee-df6aab27480c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:02 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Volume volume-14f0be7e-4cf6-45b3-9903-266504048511 (14f0be7e-4cf6-45b3-9903-266504048511): created successfully Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c43d18-5bc7-4dfd-98ee-df6aab27480c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Flow 'volume_create_manager' (2139b66b-6f33-45dd-bc03-623e46143f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-86dcc835-55ca-43a0-9051-e5452e1c95ec tempest-GroupSnapshotsTest-120082620 None] Created volume successfully. Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Acquiring lock "cinder-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Acquiring lock "cinder-quobyte-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-quobyte-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[91af708a-90d7-457b-afb6-d90bda494a44]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:03 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab Nov 03 18:29:03 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:03 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f 1073741824" returned: 0 in 0.522s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:03 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f Nov 03 18:29:03 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:03 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab" returned: 0 in 0.395s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:03 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab Nov 03 18:29:03 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:03 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.262s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2205fefd-9fa2-456b-9bae-420f908711ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639df4d5-74e3-424c-85a4-5b2e545f366f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eaa3bf-8706-46fd-8d15-8543edcf1854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9907541f-88e3-44c9-abd1-9e9a2674b485]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:03 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Volume volume-639df4d5-74e3-424c-85a4-5b2e545f366f (639df4d5-74e3-424c-85a4-5b2e545f366f): created successfully Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26eaa3bf-8706-46fd-8d15-8543edcf1854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Flow 'volume_create_manager' (f0b56be5-66c7-4714-95d5-b481c7b6aec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d7b50e3e-1687-464f-91a8-d1a44dac0f08 tempest-AttachVolumeTestJSON-729153251 None] Created volume successfully. Nov 03 18:29:03 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:29:03 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:03 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab" returned: 0 in 0.269s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-quobyte-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab" released by "delete_volume" :: held 0.720s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Created reservations ['bb326199-05f0-47b3-824e-1646f516b4ad', '4a8b4bed-8564-4d0c-8fee-b5ff880578dd', 'b50d78f2-c4e7-42a9-abdf-6b7ec977cd34', '7e40413f-1236-4d18-87c4-4821b620362b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:03 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:03 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:03 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.414s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a9099c-493d-4b8d-be95-e84b3b989af1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:03 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:29:03 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:04 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Deleted volume successfully. Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b710efb-1faa-4596-b965-06ab84e0688c tempest-VolumesTransfersV357Test-1645484661 None] Lock "cinder-64ea2e9e-9103-4d61-bd66-8795d4a1f9ab-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] GroupSnapshot 89b28121-d0b5-47a2-b28e-e34197825c5a: creating. Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Group snapshot 89b28121-d0b5-47a2-b28e-e34197825c5a: creating. {{(pid=86841) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:04 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.573s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:04 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img Nov 03 18:29:04 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-ff27d91e-bb89-4045-8ec2-5ec50411b7a1 req-be0c1935-8e7e-4887-8a26-58338cf573c7 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:11 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img" returned: 0 in 7.493s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:11 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e8146-ebff-4ffd-ad7f-bfef462ee1eb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:12 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:29:12 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:12 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.556s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:29:12 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Converted 1024.00 MB image at 136.65 MB/s Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] 2b0b4f96-feea-4772-bbce-6adad8dadc3a was raw, converting to qcow2 {{(pid=86841) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9195d53-4f72-46d0-a834-d4f04612dbf3]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:12 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img Nov 03 18:29:12 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:12 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:12 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img Nov 03 18:29:12 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:13 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img" returned: 1 in 0.358s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:13 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a Nov 03 18:29:13 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:13 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a" returned: 0 in 0.287s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Image conversion details: src /opt/stack/data/cinder/conversion/79e4aa94-838a-4fa3-a949-107911f9d3b6.temp_image.2b0b4f96-feea-4772-bbce-6adad8dadc3aejr1_cdb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:29:13 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee127a-071e-4ed8-99c6-a9bd426df6bb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:13 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a Nov 03 18:29:13 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:13 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8s8y6p3a" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.969s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Uploaded volume to glance image-id: 2b0b4f96-feea-4772-bbce-6adad8dadc3a. {{(pid=86841) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.997s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Creating offline snapshot 901b0d19-f0a8-4d0c-bf25-0acf24623058 of volume 14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:29:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1135e3c9-714e-4ecf-b320-17b233c01920 tempest-VolumesActionsTest-63142371 None] Copy volume to image completed successfully. Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5714c6d4-64cd-4c15-9361-dd3ee10132fa]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:15 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 Nov 03 18:29:15 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:15 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511" returned: 0 in 0.373s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:15 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 1G Nov 03 18:29:15 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:16 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 1G" returned: 0 in 0.551s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f0be7e-4cf6-45b3-9903-266504048511 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:16 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f0be7e-4cf6-45b3-9903-266504048511 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 Nov 03 18:29:16 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Acquiring lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:16 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14f0be7e-4cf6-45b3-9903-266504048511 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058" returned: 0 in 0.324s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:16 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:16 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 Nov 03 18:29:16 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Acquiring lock "cinder-quobyte-79e4aa94-838a-4fa3-a949-107911f9d3b6" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Lock "cinder-quobyte-79e4aa94-838a-4fa3-a949-107911f9d3b6" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8b3744-163b-4a87-875d-5d7dd19e0874]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:16 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:29:16 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:16 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058" returned: 0 in 0.267s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:16 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info Nov 03 18:29:16 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:17 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.384s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:17 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6 Nov 03 18:29:17 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:17 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:17 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info is being set with open permissions: ugo+rw: NotImplementedError Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:17 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info Nov 03 18:29:17 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:17 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-79e4aa94-838a-4fa3-a949-107911f9d3b6" returned: 0 in 0.376s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Lock "cinder-quobyte-79e4aa94-838a-4fa3-a949-107911f9d3b6" released by "delete_volume" :: held 0.811s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Created reservations ['0124a331-3fb6-475c-9b13-7b8da4e50cce', '9d6d310c-8ad5-463f-826a-68b28e750476', 'feac12cd-4220-4d25-be7a-3b1d22cef129', '4a1ea33e-781c-4b5f-bba4-44b01f985276'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:17 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.info" returned: 0 in 0.310s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.393s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-ff27d91e-bb89-4045-8ec2-5ec50411b7a1 req-be0c1935-8e7e-4887-8a26-58338cf573c7 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.690s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:17 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:17 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-ff27d91e-bb89-4045-8ec2-5ec50411b7a1 req-be0c1935-8e7e-4887-8a26-58338cf573c7 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-ff27d91e-bb89-4045-8ec2-5ec50411b7a1 req-be0c1935-8e7e-4887-8a26-58338cf573c7 tempest-AttachVolumeTestJSON-729153251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-639df4d5-74e3-424c-85a4-5b2e545f366f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10c9d780-761a-4e50-8c1d-991cede57095', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:29:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2c339af2-7d46-4c77-9b38-74381eca5678 tempest-GroupSnapshotsTest-120082620 None] group_snapshot 89b28121-d0b5-47a2-b28e-e34197825c5a: created successfully Nov 03 18:29:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-ff27d91e-bb89-4045-8ec2-5ec50411b7a1 req-be0c1935-8e7e-4887-8a26-58338cf573c7 tempest-AttachVolumeTestJSON-729153251 None] attachment_update completed successfully. Nov 03 18:29:18 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.373s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Deleted volume successfully. Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b73f58e-b2e2-434d-ae65-c692ef4e5eb0 tempest-VolumesActionsTest-63142371 None] Lock "cinder-79e4aa94-838a-4fa3-a949-107911f9d3b6-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] group_snapshot 89b28121-d0b5-47a2-b28e-e34197825c5a: deleting Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] group_snapshot 89b28121-d0b5-47a2-b28e-e34197825c5a: deleting {{(pid=86841) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-14f0be7e-4cf6-45b3-9903-266504048511" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-14f0be7e-4cf6-45b3-9903-266504048511" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-901b0d19-f0a8-4d0c-bf25-0acf24623058" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-901b0d19-f0a8-4d0c-bf25-0acf24623058" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Deleting offline snapshot 901b0d19-f0a8-4d0c-bf25-0acf24623058 of volume 14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] snapshot_file for this snap is: volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5745aa0-760c-41aa-9fca-4fd1698beca8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:18 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 Nov 03 18:29:18 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:19 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058" returned: 0 in 0.625s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14f0be7e-4cf6-45b3-9903-266504048511(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:29:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a626d2e-a79c-4a63-827b-590c9ae8cc49]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:19 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 Nov 03 18:29:19 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:19 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511" returned: 0 in 0.462s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:19 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 Nov 03 18:29:19 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:20 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058" returned: 0 in 0.549s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:20 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058 Nov 03 18:29:20 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:20 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511.901b0d19-f0a8-4d0c-bf25-0acf24623058" returned: 0 in 0.492s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-901b0d19-f0a8-4d0c-bf25-0acf24623058" released by "_delete_snapshot" :: held 2.311s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-14f0be7e-4cf6-45b3-9903-266504048511" released by "delete_snapshot" :: held 2.356s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:20 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Flow 'volume_create_manager' (02e7d2f6-304a-46bd-a3b9-9dc5c03d8444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4443cc6-0e60-432f-a5c9-13bc45bdac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4443cc6-0e60-432f-a5c9-13bc45bdac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-935271549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88ab5604ab4a528222c6b19e1c1291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:21Z,use_quota=True,user_id='81d8d2cdf89340a9b7d92c167fdb397b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d033356c-4e5a-4d28-9f3e-abd229905e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d033356c-4e5a-4d28-9f3e-abd229905e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18622caa-0bdc-4fbe-b8fd-6dd288d577e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18622caa-0bdc-4fbe-b8fd-6dd288d577e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f', 'volume_name': 'volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24321e8-84cb-453b-ae84-7a5f18d81d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24321e8-84cb-453b-ae84-7a5f18d81d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfd7cea-877d-42d0-9b56-353522719944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:21 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Volume 5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f', 'volume_size': 1} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-935271549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e88ab5604ab4a528222c6b19e1c1291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:21Z,use_quota=True,user_id='81d8d2cdf89340a9b7d92c167fdb397b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Creating volume 5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:29:21 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:21 devstack cinder-volume[86841]: WARNING cinder.quota [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1620887380 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1620887380, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:29:21 devstack cinder-volume[86841]: WARNING cinder.quota [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1620887380 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1620887380, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:29:21 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f 1073741824 Nov 03 18:29:21 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] Created reservations ['71a4d93a-1d07-4d0e-9463-3d53718e14c3', '19e93959-ae86-4ffa-b146-6030937cf3d0', '1b028126-b7fc-4f17-81d8-69f4d3d5fa0c', '830b1ec0-19be-433c-b0d8-8901610855ce'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:21 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4f395390-c2f3-40e6-8904-36ca6d9ce2da tempest-GroupSnapshotsTest-120082620 None] group_snapshot 89b28121-d0b5-47a2-b28e-e34197825c5a: deleted successfully Nov 03 18:29:21 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f 1073741824" returned: 0 in 0.597s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:21 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f Nov 03 18:29:21 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:22 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dfd7cea-877d-42d0-9b56-353522719944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3391a7f7-f4df-46e8-9ca2-0f23bb944afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:22 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Volume volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f (5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f): created successfully Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3391a7f7-f4df-46e8-9ca2-0f23bb944afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Flow 'volume_create_manager' (02e7d2f6-304a-46bd-a3b9-9dc5c03d8444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-67922435-41db-4c2a-9dee-a0ff07c372f0 tempest-AttachVolumeTestJSON-729153251 None] Created volume successfully. Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "cinder-quobyte-14f0be7e-4cf6-45b3-9903-266504048511" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-14f0be7e-4cf6-45b3-9903-266504048511" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd5637-c1c7-4794-aca1-28c7e283f051]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:22 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 Nov 03 18:29:22 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:23 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511" returned: 0 in 0.507s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:23 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511 Nov 03 18:29:23 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:23 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-14f0be7e-4cf6-45b3-9903-266504048511" returned: 0 in 0.374s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Lock "cinder-quobyte-14f0be7e-4cf6-45b3-9903-266504048511" released by "delete_volume" :: held 0.980s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['3379e1b5-6b29-4b8f-924e-ab1d2f721fb4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:23 devstack cinder-volume[86841]: WARNING cinder.quota [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1620887380 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1620887380, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Created reservations ['1b887e06-bcf9-40bb-8bf7-20bc8c0eb174', '1dc5e785-7618-4d9b-8be0-ecd2611a3993', '079fce25-934a-41b7-a12b-583967422614', 'e3a72e45-655c-4d14-8487-b5f63da97973'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:23 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:23 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:24 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.317s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:24 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b5cda7a7-1fdc-4bff-b71e-7b0401b33e94 tempest-GroupSnapshotsTest-120082620 None] Delete group completed successfully. Nov 03 18:29:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-c0ea99da-e4fd-407e-a3c4-3de82d8e258b req-c93d040e-5027-4dbc-90c2-d5eebfa4a20a tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-c0ea99da-e4fd-407e-a3c4-3de82d8e258b req-c93d040e-5027-4dbc-90c2-d5eebfa4a20a tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-c0ea99da-e4fd-407e-a3c4-3de82d8e258b req-c93d040e-5027-4dbc-90c2-d5eebfa4a20a tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:24 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-c0ea99da-e4fd-407e-a3c4-3de82d8e258b req-c93d040e-5027-4dbc-90c2-d5eebfa4a20a tempest-AttachVolumeTestJSON-729153251 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64611f3a-c0ff-4e9c-b22f-130633e395a5', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:29:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-c0ea99da-e4fd-407e-a3c4-3de82d8e258b req-c93d040e-5027-4dbc-90c2-d5eebfa4a20a tempest-AttachVolumeTestJSON-729153251 None] attachment_update completed successfully. Nov 03 18:29:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-4bf21241-a2c7-4c2e-a7b6-3577a2a6b388 req-ce80aa54-ec15-4f03-9184-89b25206fa48 tempest-AttachVolumeTestJSON-729153251 None] Terminate volume connection completed successfully. Nov 03 18:29:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-4bf21241-a2c7-4c2e-a7b6-3577a2a6b388 req-ce80aa54-ec15-4f03-9184-89b25206fa48 tempest-AttachVolumeTestJSON-729153251 None] Deleting attachment 10c9d780-761a-4e50-8c1d-991cede57095. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:29:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-e74959a4-9ec5-425d-835b-66afee1ed738 req-afa44597-e9ec-4e6f-989e-ef990ebcd0ee tempest-AttachVolumeTestJSON-729153251 None] Terminate volume connection completed successfully. Nov 03 18:29:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-e74959a4-9ec5-425d-835b-66afee1ed738 req-afa44597-e9ec-4e6f-989e-ef990ebcd0ee tempest-AttachVolumeTestJSON-729153251 None] Deleting attachment 64611f3a-c0ff-4e9c-b22f-130633e395a5. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:29:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7cab479d-236d-40a2-8560-08cc4c53a828 tempest-GroupsV320Test-1000197847 None] Group tempest-GroupsV320Test-Group-301286831: creating Nov 03 18:29:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7cab479d-236d-40a2-8560-08cc4c53a828 tempest-GroupsV320Test-1000197847 None] Group tempest-GroupsV320Test-Group-301286831: created successfully Nov 03 18:29:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7cab479d-236d-40a2-8560-08cc4c53a828 tempest-GroupsV320Test-1000197847 None] Create group completed successfully. Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Created reservations ['d17959cd-5abd-4016-8ddf-f2a1759adfae'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:37 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:37 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:37 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.311s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1d32557f-c8c7-4072-a8ad-cc237b3e3e7a tempest-GroupsV320Test-1000197847 None] Delete group completed successfully. Nov 03 18:29:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "cinder-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "cinder-quobyte-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-quobyte-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f347d9-184d-4593-8d61-5ce41dcac68d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:40 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f Nov 03 18:29:40 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:41 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f" returned: 0 in 0.439s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:41 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f Nov 03 18:29:41 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:41 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-quobyte-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f" released by "delete_volume" :: held 0.863s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Created reservations ['6e446f8d-1369-45c8-9347-35d447574006', '7af533c3-946f-4858-b301-9b0cac58dc56', 'cbe3233c-2d6a-4a34-84ac-7b18cd266892', 'ffe4b6a7-7655-4aae-a43b-5da8adf7c273'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:41 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:41 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "cinder-639df4d5-74e3-424c-85a4-5b2e545f366f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-639df4d5-74e3-424c-85a4-5b2e545f366f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "cinder-quobyte-639df4d5-74e3-424c-85a4-5b2e545f366f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-quobyte-639df4d5-74e3-424c-85a4-5b2e545f366f" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[31750e8e-41d9-4fcc-b141-93e2c8bc6060]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:41 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.310s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Deleted volume successfully. Nov 03 18:29:41 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f Nov 03 18:29:41 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-545e0c88-112d-45d5-9d03-b844dd4508f8 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-5f2d51bc-b3d0-4ac3-b9ce-b1eae814089f-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:42 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f" returned: 0 in 0.458s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:42 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f Nov 03 18:29:42 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:42 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-639df4d5-74e3-424c-85a4-5b2e545f366f" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-quobyte-639df4d5-74e3-424c-85a4-5b2e545f366f" released by "delete_volume" :: held 0.815s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Created reservations ['1ecc999e-6cf4-4c92-85fb-da3ddc4bffab', '26416ed9-d351-402a-b2c9-8ae5fc34cd76', 'd9aec9c4-e1d3-485d-ba40-c1e74591826c', 'c04aca5b-6c60-45b1-8553-f0ae0b1e411d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:42 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:42 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "cinder-5a82a677-9310-408e-a185-4a670ccf0dbb-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:43 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.341s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-5a82a677-9310-408e-a185-4a670ccf0dbb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:43 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Deleted volume successfully. Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "cinder-quobyte-5a82a677-9310-408e-a185-4a670ccf0dbb" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e94b6765-861a-4597-9e0f-fd507c6d3692 tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-639df4d5-74e3-424c-85a4-5b2e545f366f-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-quobyte-5a82a677-9310-408e-a185-4a670ccf0dbb" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f076f417-a01b-40c8-a5e4-a4d060215914]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:43 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb Nov 03 18:29:43 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:43 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:43 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb Nov 03 18:29:43 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:43 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5a82a677-9310-408e-a185-4a670ccf0dbb" returned: 0 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-quobyte-5a82a677-9310-408e-a185-4a670ccf0dbb" released by "delete_volume" :: held 0.867s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Created reservations ['a8a314aa-bef1-4697-be81-03c8fb03780d', 'beeaacc7-594c-4d5d-b8d3-92b5abfd43a9', '9844fcdf-6242-4fd1-a450-5dad00975fbd', '818105cc-beab-4efc-9a1c-72dc879bc970'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:44 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:44 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:44 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:29:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Deleted volume successfully. Nov 03 18:29:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9f49d7b-1c83-418f-9c96-fd42ab60b36c tempest-AttachVolumeTestJSON-729153251 None] Lock "cinder-5a82a677-9310-408e-a185-4a670ccf0dbb-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (14164a95-f478-4c18-9ccc-a2b02c0c73b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde4d2cc-e750-48c3-bb67-a1dff1d1eb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde4d2cc-e750-48c3-bb67-a1dff1d1eb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1086988637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a403757-6141-48df-8e25-d44b4616ef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:46Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138f420e-cca5-4330-99ed-e4f674d5f195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138f420e-cca5-4330-99ed-e4f674d5f195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198ab858-3478-4dae-9525-57bbd67d6a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198ab858-3478-4dae-9525-57bbd67d6a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a403757-6141-48df-8e25-d44b4616ef71', 'volume_name': 'volume-0a403757-6141-48df-8e25-d44b4616ef71', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1fe6cc-488d-41c1-9636-f82717f799d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1fe6cc-488d-41c1-9636-f82717f799d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc113f6f-5698-442e-861c-bcc46369db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume 0a403757-6141-48df-8e25-d44b4616ef71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a403757-6141-48df-8e25-d44b4616ef71', 'volume_size': 1} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1086988637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a403757-6141-48df-8e25-d44b4616ef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:46Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating volume 0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:29:45 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:29:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:45 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 1073741824 Nov 03 18:29:45 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:46 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 1073741824" returned: 0 in 0.601s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:46 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 Nov 03 18:29:46 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:46 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71" returned: 0 in 0.368s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc113f6f-5698-442e-861c-bcc46369db47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a403757-6141-48df-8e25-d44b4616ef71', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef33ac66-38f5-4dd8-8e05-f3ba9dcf7031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:46 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume volume-0a403757-6141-48df-8e25-d44b4616ef71 (0a403757-6141-48df-8e25-d44b4616ef71): created successfully Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef33ac66-38f5-4dd8-8e05-f3ba9dcf7031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (14164a95-f478-4c18-9ccc-a2b02c0c73b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-405a2a24-1248-473d-8583-08e852809836 tempest-VolumesSnapshotTestJSON-1952320144 None] Created volume successfully. Nov 03 18:29:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating offline snapshot ef2c5fa1-95fc-4619-bfd2-e4f247680d32 of volume 0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:29:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e9dc47-c3ff-4e5c-9afb-5756c4cd0bc9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:48 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 Nov 03 18:29:48 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:49 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:49 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 1G Nov 03 18:29:49 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:49 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 1G" returned: 0 in 0.672s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a403757-6141-48df-8e25-d44b4616ef71 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:49 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a403757-6141-48df-8e25-d44b4616ef71 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 Nov 03 18:29:49 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:50 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a403757-6141-48df-8e25-d44b4616ef71 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32" returned: 0 in 0.338s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:50 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 is being set with open permissions: ugo+rw Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:50 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 Nov 03 18:29:50 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:50 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32" returned: 0 in 0.267s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:50 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info Nov 03 18:29:50 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:50 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info" returned: 0 in 0.292s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:50 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info is being set with open permissions: ugo+rw Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:50 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info Nov 03 18:29:50 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:50 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.info" returned: 0 in 0.318s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f8ff2c85-a88e-49fb-88d7-e79fc7494f82 tempest-VolumesSnapshotTestJSON-1952320144 None] Create snapshot completed successfully Nov 03 18:29:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-ef2c5fa1-95fc-4619-bfd2-e4f247680d32-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-ef2c5fa1-95fc-4619-bfd2-e4f247680d32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:51 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=79,cinder:SELECT=80,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:29:51 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=92,cinder:UPDATE=86,cinder:INSERT=14,cinder:DELETE=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-0a403757-6141-48df-8e25-d44b4616ef71" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0a403757-6141-48df-8e25-d44b4616ef71" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-ef2c5fa1-95fc-4619-bfd2-e4f247680d32" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-ef2c5fa1-95fc-4619-bfd2-e4f247680d32" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Deleting offline snapshot ef2c5fa1-95fc-4619-bfd2-e4f247680d32 of volume 0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] snapshot_file for this snap is: volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1a602-cc7a-4f43-9e0b-9edf03b7fba0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:52 devstack sudo[96666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 Nov 03 18:29:52 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:52 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32" returned: 0 in 0.757s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a403757-6141-48df-8e25-d44b4616ef71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:29:53 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc52db-5afc-4d8d-85ae-1fb46f83631c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:53 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 Nov 03 18:29:53 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:53 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71" returned: 0 in 0.848s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:53 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 Nov 03 18:29:53 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:54 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32" returned: 0 in 0.637s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:54 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32 Nov 03 18:29:54 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:54 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71.ef2c5fa1-95fc-4619-bfd2-e4f247680d32" returned: 0 in 0.473s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-ef2c5fa1-95fc-4619-bfd2-e4f247680d32" released by "_delete_snapshot" :: held 2.977s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0a403757-6141-48df-8e25-d44b4616ef71" released by "delete_snapshot" :: held 3.010s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:55 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['2d987ead-efe6-428e-a866-3e1d567c961d', 'cb4fc6c9-dcfb-4fcf-8f1a-2a6d0604cede', '38f1f800-ff50-43ac-9c6a-7bbadd5d08aa', '7b7935ad-79a8-49d5-af70-a7e0f2e70323'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:29:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Delete snapshot completed successfully. Nov 03 18:29:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-eb38efb0-92df-40f3-ac2b-a1f27f938671 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-ef2c5fa1-95fc-4619-bfd2-e4f247680d32-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (48adbde0-9064-4b3e-83a2-1f004bcb480e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40ca91f-f862-46f2-9e50-da91085e8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e40ca91f-f862-46f2-9e50-da91085e8d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2058014163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e133eff6-dad2-44ba-a5b7-179ad8820bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:57Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89424e99-30aa-45a9-bead-7239e7c54e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89424e99-30aa-45a9-bead-7239e7c54e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b0be42-5ec9-4b7d-be7d-91bed522b534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b0be42-5ec9-4b7d-be7d-91bed522b534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e133eff6-dad2-44ba-a5b7-179ad8820bb3', 'volume_name': 'volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46091fd-6645-4b89-a472-ce676ab11dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46091fd-6645-4b89-a472-ce676ab11dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae53b52-1490-432a-b6df-0255b6eb4ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume e133eff6-dad2-44ba-a5b7-179ad8820bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3', 'volume_size': 1} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2058014163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e133eff6-dad2-44ba-a5b7-179ad8820bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:29:57Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating volume e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:29:57 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:29:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:57 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 1073741824 Nov 03 18:29:57 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:58 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 1073741824" returned: 0 in 0.648s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:58 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 Nov 03 18:29:58 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:58 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3" returned: 0 in 0.360s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae53b52-1490-432a-b6df-0255b6eb4ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6011c567-f964-49e7-ae00-789f16ce6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:29:58 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 (e133eff6-dad2-44ba-a5b7-179ad8820bb3): created successfully Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6011c567-f964-49e7-ae00-789f16ce6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:29:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (48adbde0-9064-4b3e-83a2-1f004bcb480e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:29:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1b53547b-d5de-46a7-a7f4-9ab4ca4c7587 tempest-VolumesSnapshotTestJSON-1952320144 None] Created volume successfully. Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:29:59 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:29:59 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Creating offline snapshot 0705abf3-5f6a-40af-b9a0-4f91e6457f74 of volume e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e51e44-0bd3-4425-be33-be6c59e564ef]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:29:59 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 Nov 03 18:29:59 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:29:59 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.479s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:29:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:30:00 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3" returned: 0 in 0.572s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:00 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 1G Nov 03 18:30:00 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:00 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 1G" returned: 0 in 0.610s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:00 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 Nov 03 18:30:00 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:01 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74" returned: 0 in 0.345s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:01 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 is being set with open permissions: ugo+rw Nov 03 18:30:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:01 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 Nov 03 18:30:01 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:01 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74" returned: 0 in 0.393s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:01 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info Nov 03 18:30:01 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:02 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info" returned: 0 in 0.374s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:02 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info is being set with open permissions: ugo+rw Nov 03 18:30:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:02 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info Nov 03 18:30:02 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:02 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.info" returned: 0 in 0.568s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-21eede68-1dac-464c-915d-82c4a2a6413d tempest-VolumesSnapshotTestJSON-1952320144 None] Create snapshot completed successfully Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (98b6a253-cf2d-4ef8-8596-60a4d6154c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05c829-ad07-4bf0-8e54-291e0ea94523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05c829-ad07-4bf0-8e54-291e0ea94523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-804530735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0705abf3-5f6a-40af-b9a0-4f91e6457f74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:05Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350ce3e7-0db1-45b4-bb64-ed3b9ae4d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (350ce3e7-0db1-45b4-bb64-ed3b9ae4d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de346d5c-314a-4d87-aa45-7cbc4ec5df90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de346d5c-314a-4d87-aa45-7cbc4ec5df90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc', 'volume_name': 'volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc', 'volume_size': 2, 'snapshot_id': '0705abf3-5f6a-40af-b9a0-4f91e6457f74'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1ef284-ddf5-421f-8edb-2a97701f2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1ef284-ddf5-421f-8edb-2a97701f2083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4da2512-4c13-4744-af88-f9dce6d990f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc', 'volume_size': 2, 'snapshot_id': '0705abf3-5f6a-40af-b9a0-4f91e6457f74'} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-0705abf3-5f6a-40af-b9a0-4f91e6457f74-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0705abf3-5f6a-40af-b9a0-4f91e6457f74-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating volume d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc from snapshot 0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] snapshot: 0705abf3-5f6a-40af-b9a0-4f91e6457f74, volume: d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da171d-b9eb-4e77-9a26-f064060c0f6f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:05 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 Nov 03 18:30:05 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:05 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74" returned: 0 in 0.640s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9392d064-f493-43c0-88e4-b614fb3cea47]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:05 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 Nov 03 18:30:05 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:06 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3" returned: 0 in 0.592s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:30:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:30:06 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:30:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:06 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc Nov 03 18:30:06 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:14 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:30:15 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:30:15 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" returned: 0 in 9.410s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:15 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3, size 1024.00 MB, duration 9.41 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:30:15 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Converted 1024.00 MB image at 108.80 MB/s Nov 03 18:30:15 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc is being set with open permissions: ugo+rw Nov 03 18:30:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:15 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc Nov 03 18:30:15 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:16 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" returned: 0 in 0.326s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" released by "_copy_volume_from_snapshot" :: held 11.140s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0705abf3-5f6a-40af-b9a0-4f91e6457f74-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" released by "_create_volume_from_snapshot" :: held 11.265s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.288s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4da2512-4c13-4744-af88-f9dce6d990f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc', 'volume_size': 2, 'snapshot_id': '0705abf3-5f6a-40af-b9a0-4f91e6457f74'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095564f0-2e92-4d59-9b28-b1bd1b0032d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:16 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc (d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc): created successfully Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095564f0-2e92-4d59-9b28-b1bd1b0032d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (98b6a253-cf2d-4ef8-8596-60a4d6154c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9d2d2520-a218-4787-8126-3405e4cb2a13 tempest-VolumesSnapshotTestJSON-1952320144 None] Created volume successfully. Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e5c61-be5e-453e-ac64-befe6c86c26a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:17 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc Nov 03 18:30:17 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:17 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" returned: 0 in 0.460s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:18 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc Nov 03 18:30:18 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:18 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc" released by "delete_volume" :: held 1.000s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['2ace507a-d180-4e8d-b77c-4bb9a4993525', '0f77faa7-5154-4049-ae70-4322a0c0d76a', '404b6473-e42b-492a-88fe-a033f98bd924', '62ea2d6f-5a64-4b85-b147-311d54f5f139'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:18 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:18 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:18 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.295s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Deleted volume successfully. Nov 03 18:30:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-561482f3-6241-4be1-bbed-3749c337354c tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-d34b0204-89bd-4eaf-a6b6-0ab9a8d65ecc-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-0705abf3-5f6a-40af-b9a0-4f91e6457f74-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-0705abf3-5f6a-40af-b9a0-4f91e6457f74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-e133eff6-dad2-44ba-a5b7-179ad8820bb3" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-e133eff6-dad2-44ba-a5b7-179ad8820bb3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-0705abf3-5f6a-40af-b9a0-4f91e6457f74" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0705abf3-5f6a-40af-b9a0-4f91e6457f74" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Deleting offline snapshot 0705abf3-5f6a-40af-b9a0-4f91e6457f74 of volume e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] snapshot_file for this snap is: volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b177c30c-e40d-4c8b-899c-9341d9aa8c8e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:19 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 Nov 03 18:30:19 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:20 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74" returned: 0 in 0.423s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:30:20 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2428ef-2e83-4f44-ad8a-0ae003a89064]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:20 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 Nov 03 18:30:20 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:20 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3" returned: 0 in 0.830s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:20 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 Nov 03 18:30:20 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:21 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74" returned: 0 in 0.548s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:21 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74 Nov 03 18:30:21 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Flow 'volume_create_manager' (281827a1-657b-4a43-9ea7-d97c874deca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254c8ffd-0857-4b0e-b0c1-89212351f315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:21 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3.0705abf3-5f6a-40af-b9a0-4f91e6457f74" returned: 0 in 0.400s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254c8ffd-0857-4b0e-b0c1-89212351f315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1733328078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b977e3d6-23a8-4a88-93f5-f0cf7d84f08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6f408a695d4f21833d53f1b983c3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:22Z,use_quota=True,user_id='314ef78794f247669c5f23d3fe8502cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2328b190-91fa-4048-b890-257b81f384b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2328b190-91fa-4048-b890-257b81f384b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbb1f34-8d72-4ed8-a9e3-4ca23d05e36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbb1f34-8d72-4ed8-a9e3-4ca23d05e36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b977e3d6-23a8-4a88-93f5-f0cf7d84f08f', 'volume_name': 'volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b395e59c-b5d3-4ecb-88b6-b968704c5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b395e59c-b5d3-4ecb-88b6-b968704c5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc508f19-4669-4165-917c-6e19dee6c34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:21 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Volume b977e3d6-23a8-4a88-93f5-f0cf7d84f08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f', 'volume_size': 1} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1733328078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b977e3d6-23a8-4a88-93f5-f0cf7d84f08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6f408a695d4f21833d53f1b983c3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:22Z,use_quota=True,user_id='314ef78794f247669c5f23d3fe8502cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Creating volume b977e3d6-23a8-4a88-93f5-f0cf7d84f08f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:30:21 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:30:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:22 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f 1073741824 Nov 03 18:30:22 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0705abf3-5f6a-40af-b9a0-4f91e6457f74" released by "_delete_snapshot" :: held 2.435s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-e133eff6-dad2-44ba-a5b7-179ad8820bb3" released by "delete_snapshot" :: held 2.466s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:22 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['e34e1fdd-2114-46b1-b2a1-6213c2c5bc2d', '1113ddfa-a436-4e4b-a565-4f590d62e842', '709876af-5148-48eb-aab9-c71f72ea0a02', '5fe396be-9849-4cc2-8f48-7fb3785cf20d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Delete snapshot completed successfully. Nov 03 18:30:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fb156871-4cda-4a3e-b89c-f04a5aee900f tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-0705abf3-5f6a-40af-b9a0-4f91e6457f74-delete_snapshot" released by "delete_snapshot" :: held 2.798s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:22 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f 1073741824" returned: 0 in 0.679s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:22 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f Nov 03 18:30:22 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-e133eff6-dad2-44ba-a5b7-179ad8820bb3-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-e133eff6-dad2-44ba-a5b7-179ad8820bb3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:23 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f" returned: 0 in 0.420s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc508f19-4669-4165-917c-6e19dee6c34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599551a0-f231-4e80-b814-fa49ba56f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:23 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Volume volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f (b977e3d6-23a8-4a88-93f5-f0cf7d84f08f): created successfully Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599551a0-f231-4e80-b814-fa49ba56f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Flow 'volume_create_manager' (281827a1-657b-4a43-9ea7-d97c874deca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-e133eff6-dad2-44ba-a5b7-179ad8820bb3" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9ffc02dd-6234-48d2-a480-f3a1282c9f15 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Created volume successfully. Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-e133eff6-dad2-44ba-a5b7-179ad8820bb3" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[99519ca9-de4b-4d3c-9975-d5d82ba0c561]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:23 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 Nov 03 18:30:23 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:23 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3" returned: 0 in 0.562s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:23 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3 Nov 03 18:30:23 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:24 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e133eff6-dad2-44ba-a5b7-179ad8820bb3" returned: 0 in 0.372s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-e133eff6-dad2-44ba-a5b7-179ad8820bb3" released by "delete_volume" :: held 1.044s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['f5ec3662-2a7d-4fd2-ad6b-e11172756122', '41142297-e112-4141-839c-d0eb58fcf7e1', '7271eb3f-4585-44f9-88d7-dc15199f2a07', '69a18d79-ba4c-4cfa-ab30-326508455ada'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:24 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:24 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:24 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.311s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Deleted volume successfully. Nov 03 18:30:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0d24dc3d-af6c-4dda-8ba7-93c31978b60d tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-e133eff6-dad2-44ba-a5b7-179ad8820bb3-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e064f1b8-be25-40d3-ab9d-9cd22a4cb2c5 req-8b9c95de-72b9-4922-8783-a9fb9901ac24 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e064f1b8-be25-40d3-ab9d-9cd22a4cb2c5 req-8b9c95de-72b9-4922-8783-a9fb9901ac24 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e064f1b8-be25-40d3-ab9d-9cd22a4cb2c5 req-8b9c95de-72b9-4922-8783-a9fb9901ac24 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-e064f1b8-be25-40d3-ab9d-9cd22a4cb2c5 req-8b9c95de-72b9-4922-8783-a9fb9901ac24 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de142b0d-147c-481c-9cbc-88da943ac17e', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:30:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-e064f1b8-be25-40d3-ab9d-9cd22a4cb2c5 req-8b9c95de-72b9-4922-8783-a9fb9901ac24 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] attachment_update completed successfully. Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (b67bcb33-1c3f-4648-8875-1632f3bc57ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6219748-4d58-4c58-822d-269ad94b2d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6219748-4d58-4c58-822d-269ad94b2d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875542573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16404a93-a6ec-4f8a-bf46-54d857aaa3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:26Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cbdfab-1b78-4664-aab6-8c17b7049811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cbdfab-1b78-4664-aab6-8c17b7049811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec62ceb6-da40-425a-9ab8-bc7ab38f93f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec62ceb6-da40-425a-9ab8-bc7ab38f93f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16404a93-a6ec-4f8a-bf46-54d857aaa3dd', 'volume_name': 'volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19dbbf13-460e-435e-8f23-b9cc319a95d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19dbbf13-460e-435e-8f23-b9cc319a95d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d435ca-0079-4756-8439-0eb49b3e586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume 16404a93-a6ec-4f8a-bf46-54d857aaa3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd', 'volume_size': 1} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1875542573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16404a93-a6ec-4f8a-bf46-54d857aaa3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:26Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating volume 16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:30:26 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:26 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd 1073741824 Nov 03 18:30:26 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:26 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd 1073741824" returned: 0 in 0.580s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:27 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd Nov 03 18:30:27 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:27 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" returned: 0 in 0.439s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d435ca-0079-4756-8439-0eb49b3e586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a1d131-eda1-47ca-9ebb-771a1499dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:27 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd (16404a93-a6ec-4f8a-bf46-54d857aaa3dd): created successfully Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a1d131-eda1-47ca-9ebb-771a1499dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (b67bcb33-1c3f-4648-8875-1632f3bc57ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-00bec525-61c9-4eb0-9ecb-7de052e7d909 tempest-VolumesSnapshotTestJSON-1952320144 None] Created volume successfully. Nov 03 18:30:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating offline snapshot 8decc35b-7808-4350-b9e0-322c59f140e5 of volume 16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:30:28 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69a805-0752-4f87-9b31-cb6461b7479d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:29 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd Nov 03 18:30:29 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:29 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" returned: 0 in 1.026s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:30 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 1G Nov 03 18:30:30 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-fe15a7b3-15fa-4ef2-9a80-4e2df07579ac req-12a1d5f4-2860-44b9-8f27-c651e4403293 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Terminate volume connection completed successfully. Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-fe15a7b3-15fa-4ef2-9a80-4e2df07579ac req-12a1d5f4-2860-44b9-8f27-c651e4403293 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Deleting attachment de142b0d-147c-481c-9cbc-88da943ac17e. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Acquiring lock "cinder-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "cinder-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Acquiring lock "cinder-quobyte-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:30 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 1G" returned: 0 in 0.980s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "cinder-quobyte-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f" acquired by "delete_volume" :: waited 0.043s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:31 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 Nov 03 18:30:31 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa2530f-585b-4e61-920e-37bd7f7f5ad7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:31 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f Nov 03 18:30:31 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:31 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5" returned: 0 in 0.455s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:31 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 is being set with open permissions: ugo+rw Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:31 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 Nov 03 18:30:31 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:31 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f" returned: 0 in 0.701s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:31 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f Nov 03 18:30:31 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:31 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5" returned: 0 in 0.442s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:32 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info Nov 03 18:30:32 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:32 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f" returned: 0 in 0.622s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "cinder-quobyte-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f" released by "delete_volume" :: held 1.428s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Created reservations ['663d9560-3af0-4dfb-af6f-181f71934a7c', 'ac506199-8fb2-4b91-86e0-0061ddf42baf', '24e4e608-c7a5-4da2-b3c6-dbbaad9d8f36', '824ef91e-bb16-4a2d-9093-e13be1512821'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:32 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info" returned: 0 in 0.621s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:32 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info is being set with open permissions: ugo+rw Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:32 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info Nov 03 18:30:32 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:32 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:32 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:33 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.info" returned: 0 in 0.519s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:33 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.324s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:33 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Deleted volume successfully. Nov 03 18:30:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8a56e290-ed5c-4810-bbaa-0fd2c1e8ad94 tempest-VolumesSnapshotTestJSON-1952320144 None] Create snapshot completed successfully Nov 03 18:30:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9612fcfc-8dcf-455d-8762-ad9726dc44a4 tempest-TestServerVolumeAttachScenarioOldVersion-1270723877 None] Lock "cinder-b977e3d6-23a8-4a88-93f5-f0cf7d84f08f-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (7e5c3f46-9fa8-4c19-82a3-6e17d1aa6411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb6066a-92cd-49c3-a734-e4908115f89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb6066a-92cd-49c3-a734-e4908115f89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1573893857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e80ec6-1a02-4008-8be5-0688b79de182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c736341df04a4d168f3a75eeaf12fced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8decc35b-7808-4350-b9e0-322c59f140e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:35Z,use_quota=True,user_id='f24869516ad2438fbfad2d57d837d72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca0db75-cc1b-4462-8bdd-3920e897c074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca0db75-cc1b-4462-8bdd-3920e897c074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5e7934-1ff0-4951-945c-b1b58745e2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5e7934-1ff0-4951-945c-b1b58745e2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd9e80ec6-1a02-4008-8be5-0688b79de182', 'volume_name': 'volume-d9e80ec6-1a02-4008-8be5-0688b79de182', 'volume_size': 1, 'snapshot_id': '8decc35b-7808-4350-b9e0-322c59f140e5'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac410389-bfbc-49e8-9ae5-ef36a4d43cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac410389-bfbc-49e8-9ae5-ef36a4d43cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce96abe1-6022-432f-9ef6-237e08be1cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:35 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume d9e80ec6-1a02-4008-8be5-0688b79de182: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d9e80ec6-1a02-4008-8be5-0688b79de182', 'volume_size': 1, 'snapshot_id': '8decc35b-7808-4350-b9e0-322c59f140e5'} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-8decc35b-7808-4350-b9e0-322c59f140e5-d9e80ec6-1a02-4008-8be5-0688b79de182" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-8decc35b-7808-4350-b9e0-322c59f140e5-d9e80ec6-1a02-4008-8be5-0688b79de182" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating volume d9e80ec6-1a02-4008-8be5-0688b79de182 from snapshot 8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-d9e80ec6-1a02-4008-8be5-0688b79de182" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d9e80ec6-1a02-4008-8be5-0688b79de182" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] snapshot: 8decc35b-7808-4350-b9e0-322c59f140e5, volume: d9e80ec6-1a02-4008-8be5-0688b79de182, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a13a9a-3348-4413-8ee2-86d811ef505a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:35 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 Nov 03 18:30:35 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:36 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5" returned: 0 in 0.633s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a2085-cf0f-42bf-8e9c-dab5e9f1f891]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:36 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd Nov 03 18:30:36 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:36 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" returned: 0 in 0.642s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:30:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:36 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 Nov 03 18:30:36 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:45 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=44,cinder:SELECT=38,cinder:INSERT=7,cinder:DELETE=5 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:30:45 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=40,cinder:UPDATE=39,cinder:DELETE=2,cinder:INSERT=13 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (ff814da4-d323-45de-894c-d54c77fe5d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d90504-cc69-4667-9305-c514d7f08379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d90504-cc69-4667-9305-c514d7f08379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419137395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe19274-6884-46a9-8e14-009f6c05d4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:48Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0fd4ba-c952-4199-8152-639e51c75204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0fd4ba-c952-4199-8152-639e51c75204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b69ed9-321c-4dab-9136-83e39901d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79b69ed9-321c-4dab-9136-83e39901d39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe19274-6884-46a9-8e14-009f6c05d4d0', 'volume_name': 'volume-efe19274-6884-46a9-8e14-009f6c05d4d0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00099e4-766a-4017-a49e-1440468ea787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00099e4-766a-4017-a49e-1440468ea787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd228728-47e7-41dc-bc97-89cb2771f059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:48 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Volume efe19274-6884-46a9-8e14-009f6c05d4d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe19274-6884-46a9-8e14-009f6c05d4d0', 'volume_size': 1} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:48 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182" returned: 0 in 11.789s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd, size 1024.00 MB, duration 11.79 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:30:48 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Converted 1024.00 MB image at 86.85 MB/s Nov 03 18:30:48 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 is being set with open permissions: ugo+rw Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:48 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 Nov 03 18:30:48 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:48 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182" returned: 0 in 0.259s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d9e80ec6-1a02-4008-8be5-0688b79de182" released by "_copy_volume_from_snapshot" :: held 13.459s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-8decc35b-7808-4350-b9e0-322c59f140e5-d9e80ec6-1a02-4008-8be5-0688b79de182" released by "_create_volume_from_snapshot" :: held 13.557s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.595s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-419137395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe19274-6884-46a9-8e14-009f6c05d4d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:48Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Creating volume efe19274-6884-46a9-8e14-009f6c05d4d0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:30:49 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce96abe1-6022-432f-9ef6-237e08be1cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e80ec6-1a02-4008-8be5-0688b79de182', 'volume_size': 1, 'snapshot_id': '8decc35b-7808-4350-b9e0-322c59f140e5'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:49 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 1073741824 Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14a9a27-bc99-4e34-ab24-ca818fbc21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:49 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Volume volume-d9e80ec6-1a02-4008-8be5-0688b79de182 (d9e80ec6-1a02-4008-8be5-0688b79de182): created successfully Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14a9a27-bc99-4e34-ab24-ca818fbc21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Flow 'volume_create_manager' (7e5c3f46-9fa8-4c19-82a3-6e17d1aa6411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e0342391-038f-457d-8f44-82bc5c9c8a76 tempest-VolumesSnapshotTestJSON-1952320144 None] Created volume successfully. Nov 03 18:30:49 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 1073741824" returned: 0 in 0.457s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:49 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 Nov 03 18:30:49 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-d9e80ec6-1a02-4008-8be5-0688b79de182-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-d9e80ec6-1a02-4008-8be5-0688b79de182-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:49 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0" returned: 0 in 0.289s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd228728-47e7-41dc-bc97-89cb2771f059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe19274-6884-46a9-8e14-009f6c05d4d0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f1465-574c-4227-9bc3-7ac9c70c616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Volume volume-efe19274-6884-46a9-8e14-009f6c05d4d0 (efe19274-6884-46a9-8e14-009f6c05d4d0): created successfully Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23f1465-574c-4227-9bc3-7ac9c70c616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (ff814da4-d323-45de-894c-d54c77fe5d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-d9e80ec6-1a02-4008-8be5-0688b79de182" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c1d454d1-e3f1-43e0-a987-1b654b6bee31 tempest-VolumesActionsTest-865860542 None] Created volume successfully. Nov 03 18:30:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d9e80ec6-1a02-4008-8be5-0688b79de182" acquired by "delete_volume" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0781bd-9f5e-4534-8c9c-1e5a76d6d171]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:50 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 Nov 03 18:30:50 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:50 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182" returned: 0 in 0.620s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:50 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182 Nov 03 18:30:50 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:50 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d9e80ec6-1a02-4008-8be5-0688b79de182" returned: 0 in 0.343s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-d9e80ec6-1a02-4008-8be5-0688b79de182" released by "delete_volume" :: held 1.042s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['fcc012d1-0106-4081-b5e4-8fdd7a4b0f41', '36a5b51e-3c90-4f27-99a0-d0daaffb6ded', 'caa40917-deb7-4a1e-a116-1391b83309fd', 'ef28d821-315f-44f7-84df-54d2d4c80271'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a12fa56b-652e-490b-b3df-f3e808612f26 tempest-VolumesActionsTest-865860542 None] Acquiring lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0" by "attach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a12fa56b-652e-490b-b3df-f3e808612f26 tempest-VolumesActionsTest-865860542 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0" acquired by "attach_volume" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:51 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:51 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a12fa56b-652e-490b-b3df-f3e808612f26 tempest-VolumesActionsTest-865860542 None] Attaching volume efe19274-6884-46a9-8e14-009f6c05d4d0 to instance 624a25dd-67d3-4944-a365-7c466e5d659a at mountpoint /dev/vdb on host None. Nov 03 18:30:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a12fa56b-652e-490b-b3df-f3e808612f26 tempest-VolumesActionsTest-865860542 None] Attach volume completed successfully. Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a12fa56b-652e-490b-b3df-f3e808612f26 tempest-VolumesActionsTest-865860542 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0" released by "attach_volume" :: held 0.117s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:51 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.448s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Deleted volume successfully. Nov 03 18:30:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c452452-c0dc-42c6-b898-2d0134c624a4 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-d9e80ec6-1a02-4008-8be5-0688b79de182-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-8decc35b-7808-4350-b9e0-322c59f140e5-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-8decc35b-7808-4350-b9e0-322c59f140e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-8decc35b-7808-4350-b9e0-322c59f140e5" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-8decc35b-7808-4350-b9e0-322c59f140e5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Deleting offline snapshot 8decc35b-7808-4350-b9e0-322c59f140e5 of volume 16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] snapshot_file for this snap is: volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:30:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b0e5799a-8c47-47a5-a023-9fae981b5654 tempest-VolumesActionsTest-1462383193 None] Terminate volume connection completed successfully. Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a095a9-eeac-4bf6-a5ce-5d924ec39ea7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0e5799a-8c47-47a5-a023-9fae981b5654 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-detach_volume" by "detach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0e5799a-8c47-47a5-a023-9fae981b5654 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b0e5799a-8c47-47a5-a023-9fae981b5654 tempest-VolumesActionsTest-1462383193 None] Detaching volume efe19274-6884-46a9-8e14-009f6c05d4d0 from instance 624a25dd-67d3-4944-a365-7c466e5d659a. Nov 03 18:30:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b0e5799a-8c47-47a5-a023-9fae981b5654 tempest-VolumesActionsTest-1462383193 None] Detach volume completed successfully. Nov 03 18:30:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0e5799a-8c47-47a5-a023-9fae981b5654 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:52 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 Nov 03 18:30:52 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afd9d16a-67e9-4eb1-aeb4-54802646cfe9 tempest-VolumesActionsTest-865860542 None] Acquiring lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-detach_volume" by "detach_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afd9d16a-67e9-4eb1-aeb4-54802646cfe9 tempest-VolumesActionsTest-865860542 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:53 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-afd9d16a-67e9-4eb1-aeb4-54802646cfe9 tempest-VolumesActionsTest-865860542 None] Volume detach called, but volume not attached. Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afd9d16a-67e9-4eb1-aeb4-54802646cfe9 tempest-VolumesActionsTest-865860542 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:53 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5" returned: 0 in 0.619s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2295df4a-75ae-424d-9ad5-bb8075ace374]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:53 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd Nov 03 18:30:53 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Acquiring lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Acquiring lock "cinder-quobyte-efe19274-6884-46a9-8e14-009f6c05d4d0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Lock "cinder-quobyte-efe19274-6884-46a9-8e14-009f6c05d4d0" acquired by "delete_volume" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d20c7ab-842f-442d-b0c7-a78d96220cf0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:53 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 Nov 03 18:30:53 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:54 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0" returned: 0 in 0.503s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:54 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0 Nov 03 18:30:54 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:54 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" returned: 0 in 1.020s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:54 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 Nov 03 18:30:54 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:54 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-efe19274-6884-46a9-8e14-009f6c05d4d0" returned: 0 in 0.335s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Lock "cinder-quobyte-efe19274-6884-46a9-8e14-009f6c05d4d0" released by "delete_volume" :: held 0.953s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Created reservations ['035baa2a-6edb-4b14-aa79-66737270f484', 'fd8006ad-06a3-4111-9b23-158727febc00', 'c7795fde-27d0-4c52-8d17-e52f025b25dd', 'bd26061b-cd22-4c3c-a1ad-9406c233767b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:54 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:54 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Flow 'volume_create_manager' (56ac5ea3-b6d8-470e-9e49-b3060d895882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1365e9fc-c2ed-4fb7-a024-dd988d7a195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1365e9fc-c2ed-4fb7-a024-dd988d7a195b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1960721331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66cad7d-af3e-4c77-9b30-9f71884dbe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5639e891332048349c73a62acf754c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:55Z,use_quota=True,user_id='124955aee72f4b5aaf34b5f51a01d2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a617ef-6064-4096-9ea2-72341a6412b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a617ef-6064-4096-9ea2-72341a6412b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c3184e-38db-4d23-afc5-51c99aa4e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c3184e-38db-4d23-afc5-51c99aa4e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f66cad7d-af3e-4c77-9b30-9f71884dbe6d', 'volume_name': 'volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540a2b98-8b6a-4670-b554-ad7ffabd82b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540a2b98-8b6a-4670-b554-ad7ffabd82b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8935885e-124e-4419-8768-8fb8f99b2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Volume f66cad7d-af3e-4c77-9b30-9f71884dbe6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d', 'volume_size': 1} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1960721331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66cad7d-af3e-4c77-9b30-9f71884dbe6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5639e891332048349c73a62acf754c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:30:55Z,use_quota=True,user_id='124955aee72f4b5aaf34b5f51a01d2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Creating volume f66cad7d-af3e-4c77-9b30-9f71884dbe6d {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:54 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:30:54 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5" returned: 0 in 0.744s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:55 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5 Nov 03 18:30:55 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d 1073741824 Nov 03 18:30:55 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:55 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:55 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.533s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Deleted volume successfully. Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-113679cb-d1a2-4080-9fa9-5a0b8df6a4d9 tempest-VolumesActionsTest-865860542 None] Lock "cinder-efe19274-6884-46a9-8e14-009f6c05d4d0-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:55 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd.8decc35b-7808-4350-b9e0-322c59f140e5" returned: 0 in 0.394s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-8decc35b-7808-4350-b9e0-322c59f140e5" released by "_delete_snapshot" :: held 2.942s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" released by "delete_snapshot" :: held 2.979s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['075a8761-db0c-4972-b657-938ebceb2571', '202e5c67-5b2a-49d7-9a67-694df6cfc7eb', '63d31287-5207-4f8b-b7cb-9c22747f7b02', '4ea4cd67-4d64-49e9-aa3e-d23e09e55b6b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Delete snapshot completed successfully. Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0f33be44-118e-464d-b516-8e058710a2e1 tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-8decc35b-7808-4350-b9e0-322c59f140e5-delete_snapshot" released by "delete_snapshot" :: held 3.247s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:55 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d 1073741824" returned: 0 in 0.852s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-16404a93-a6ec-4f8a-bf46-54d857aaa3dd-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:55 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d Nov 03 18:30:55 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-16404a93-a6ec-4f8a-bf46-54d857aaa3dd-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcaeffb-2044-4cef-9a88-88016ca9d081]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:56 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd Nov 03 18:30:56 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:56 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d" returned: 0 in 0.531s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8935885e-124e-4419-8768-8fb8f99b2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22129543-8148-4a14-bf6f-45cdbea5e2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:30:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Volume volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d (f66cad7d-af3e-4c77-9b30-9f71884dbe6d): created successfully Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22129543-8148-4a14-bf6f-45cdbea5e2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Flow 'volume_create_manager' (56ac5ea3-b6d8-470e-9e49-b3060d895882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:30:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3ca60ee9-dc25-4d17-929a-d305cc5c551c tempest-AttachVolumeNegativeTest-1551287458 None] Created volume successfully. Nov 03 18:30:56 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" returned: 0 in 0.684s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:56 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd Nov 03 18:30:56 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:57 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" returned: 0 in 0.370s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-16404a93-a6ec-4f8a-bf46-54d857aaa3dd" released by "delete_volume" :: held 1.192s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['e98b1858-c4a5-4f8c-b5dd-907945ee011f', '0ec8f700-ee95-45c8-823b-3dcc247e2fb2', '75ce9781-c891-42f0-85be-511b442226ea', '5fc49516-33bd-49b4-9dc4-3c99fe76b455'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:57 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:57 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:57 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.315s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Deleted volume successfully. Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ed00ed6b-df54-4f3f-a9ef-247e5e714fef tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-16404a93-a6ec-4f8a-bf46-54d857aaa3dd-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e9e0d8d6-c59f-4bef-86f0-03c1d08e1598 req-02e777e9-63bc-450c-b025-3f966fbe5add tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e9e0d8d6-c59f-4bef-86f0-03c1d08e1598 req-02e777e9-63bc-450c-b025-3f966fbe5add tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-e9e0d8d6-c59f-4bef-86f0-03c1d08e1598 req-02e777e9-63bc-450c-b025-3f966fbe5add tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-e9e0d8d6-c59f-4bef-86f0-03c1d08e1598 req-02e777e9-63bc-450c-b025-3f966fbe5add tempest-AttachVolumeNegativeTest-1551287458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a4faadb-8a4f-4957-b672-b2994744f107', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:30:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-e9e0d8d6-c59f-4bef-86f0-03c1d08e1598 req-02e777e9-63bc-450c-b025-3f966fbe5add tempest-AttachVolumeNegativeTest-1551287458 None] attachment_update completed successfully. Nov 03 18:30:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-0a403757-6141-48df-8e25-d44b4616ef71-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-0a403757-6141-48df-8e25-d44b4616ef71-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "cinder-quobyte-0a403757-6141-48df-8e25-d44b4616ef71" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:30:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0a403757-6141-48df-8e25-d44b4616ef71" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:30:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3209add1-8075-479b-94a3-3678bb7efbf7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:30:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:58 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 Nov 03 18:30:58 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:59 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71" returned: 0 in 0.550s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:59 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71 Nov 03 18:30:59 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:59 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:59 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:30:59 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a403757-6141-48df-8e25-d44b4616ef71" returned: 0 in 0.404s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-quobyte-0a403757-6141-48df-8e25-d44b4616ef71" released by "delete_volume" :: held 1.078s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Created reservations ['378f5109-d39c-4f04-ae66-294c632d0d9a', '30284fc6-dff6-4f3f-b147-b70989cee031', '0df8f9a4-d1f6-4e98-9554-0089d8238a08', 'f39eacbc-94fb-4245-a249-5efce72e8f22'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:30:59 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.432s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:30:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:30:59 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:30:59 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (4607d27b-1777-41b4-bf80-6cfbcc4bd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05c6d0a-b210-451c-9b10-c9ec06016980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05c6d0a-b210-451c-9b10-c9ec06016980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-56472615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcacaed-14f6-46bf-b57a-73758d1002b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:00Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015a961f-ff9a-45d7-a20d-a0a5b91294c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015a961f-ff9a-45d7-a20d-a0a5b91294c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f72fcd-b2f5-4dc0-8928-20a3dd7d7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f72fcd-b2f5-4dc0-8928-20a3dd7d7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcacaed-14f6-46bf-b57a-73758d1002b7', 'volume_name': 'volume-9dcacaed-14f6-46bf-b57a-73758d1002b7', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d14f60-6999-4379-a5ab-30738639695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d14f60-6999-4379-a5ab-30738639695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73750f3-069a-439a-b65a-fda42bb798ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Volume 9dcacaed-14f6-46bf-b57a-73758d1002b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcacaed-14f6-46bf-b57a-73758d1002b7', 'volume_size': 1} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-56472615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcacaed-14f6-46bf-b57a-73758d1002b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:00Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Creating volume 9dcacaed-14f6-46bf-b57a-73758d1002b7 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:00 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:00 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.371s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:31:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Deleted volume successfully. Nov 03 18:31:00 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 1073741824 Nov 03 18:31:00 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-47ea4bc2-eb25-42ae-8b15-f9bde80ae01e tempest-VolumesSnapshotTestJSON-1952320144 None] Lock "cinder-0a403757-6141-48df-8e25-d44b4616ef71-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:00 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 1073741824" returned: 0 in 0.586s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:00 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 Nov 03 18:31:00 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:01 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7" returned: 0 in 0.302s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73750f3-069a-439a-b65a-fda42bb798ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcacaed-14f6-46bf-b57a-73758d1002b7', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96477664-75e8-4a96-93ae-4ee576fb2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:01 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Volume volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 (9dcacaed-14f6-46bf-b57a-73758d1002b7): created successfully Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96477664-75e8-4a96-93ae-4ee576fb2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (4607d27b-1777-41b4-bf80-6cfbcc4bd223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d4710af6-b7da-4b0e-b422-6d3c1dfa1ea5 tempest-VolumesActionsTest-865860542 None] Created volume successfully. Nov 03 18:31:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-9dcacaed-14f6-46bf-b57a-73758d1002b7-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-9dcacaed-14f6-46bf-b57a-73758d1002b7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-quobyte-9dcacaed-14f6-46bf-b57a-73758d1002b7" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-9dcacaed-14f6-46bf-b57a-73758d1002b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed6113d-480a-4282-929d-f787bc03c0b8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:02 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 Nov 03 18:31:02 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:03 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7" returned: 0 in 0.489s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:03 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7 Nov 03 18:31:03 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:03 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9dcacaed-14f6-46bf-b57a-73758d1002b7" returned: 0 in 0.303s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-9dcacaed-14f6-46bf-b57a-73758d1002b7" released by "delete_volume" :: held 0.851s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Created reservations ['4c32b089-4700-49f5-900e-3e6332744a3d', '9b3bfffa-efd5-46f2-ad54-6fcf0ea895bc', 'bf4ee5a3-fe2a-4be0-9dcf-7f6a267c8e6a', '8c5c3bb1-c403-455f-8dd5-3e5a1463f98b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:03 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:31:03 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:03 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.494s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:31:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Deleted volume successfully. Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-83e54214-45ca-4c47-92fc-c84b9524e7d9 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-9dcacaed-14f6-46bf-b57a-73758d1002b7-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (1f480f3b-6ecc-4504-998b-6057dedc4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3421d9c2-a940-4c7b-8484-d06aa21ace98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3421d9c2-a940-4c7b-8484-d06aa21ace98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-944044374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510b4174-145c-4e0d-bf12-8bcbe44d452f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:04Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307f3f8d-be7f-425a-8506-6afc6bbeb1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307f3f8d-be7f-425a-8506-6afc6bbeb1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e282168-dcb1-4f3a-9acf-107da1c80e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e282168-dcb1-4f3a-9acf-107da1c80e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510b4174-145c-4e0d-bf12-8bcbe44d452f', 'volume_name': 'volume-510b4174-145c-4e0d-bf12-8bcbe44d452f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bde7933-6eb7-4517-94da-5adda0f3c79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bde7933-6eb7-4517-94da-5adda0f3c79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffb146e-a965-4c41-8bb3-7fa66e0137d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Volume 510b4174-145c-4e0d-bf12-8bcbe44d452f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510b4174-145c-4e0d-bf12-8bcbe44d452f', 'volume_size': 1} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-944044374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510b4174-145c-4e0d-bf12-8bcbe44d452f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:04Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Creating volume 510b4174-145c-4e0d-bf12-8bcbe44d452f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:04 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:04 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f 1073741824 Nov 03 18:31:04 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:05 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f 1073741824" returned: 0 in 0.655s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:05 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f Nov 03 18:31:05 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:05 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f" returned: 0 in 0.344s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffb146e-a965-4c41-8bb3-7fa66e0137d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510b4174-145c-4e0d-bf12-8bcbe44d452f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da4b22a-3d39-4509-9fc2-ac427b6d1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Volume volume-510b4174-145c-4e0d-bf12-8bcbe44d452f (510b4174-145c-4e0d-bf12-8bcbe44d452f): created successfully Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da4b22a-3d39-4509-9fc2-ac427b6d1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (1f480f3b-6ecc-4504-998b-6057dedc4f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-71d87786-5c32-49e5-b449-0dc7416d94b4 tempest-VolumesActionsTest-865860542 None] Created volume successfully. Nov 03 18:31:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-510b4174-145c-4e0d-bf12-8bcbe44d452f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Lock "cinder-510b4174-145c-4e0d-bf12-8bcbe44d452f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-quobyte-510b4174-145c-4e0d-bf12-8bcbe44d452f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-510b4174-145c-4e0d-bf12-8bcbe44d452f" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477a535-ace5-4f4b-8c5c-b13bf1cc00f6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:07 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f Nov 03 18:31:07 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:07 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f" returned: 0 in 0.564s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:07 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f Nov 03 18:31:07 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:08 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-510b4174-145c-4e0d-bf12-8bcbe44d452f" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-510b4174-145c-4e0d-bf12-8bcbe44d452f" released by "delete_volume" :: held 0.959s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Created reservations ['b63384d2-f37d-4536-b082-50327fd0d04c', '83f6ff3d-2354-46d8-a6a7-579b5b753018', '3f44e8d2-fada-4ea7-9548-d1f38347efbb', '1137b7e8-4635-41c9-bb35-b19319db64d7'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:08 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:31:08 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:08 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:31:08 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Deleted volume successfully. Nov 03 18:31:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-075737e6-f01a-4fd1-ab9f-9fd65a916b9b tempest-VolumesActionsTest-1462383193 None] Lock "cinder-510b4174-145c-4e0d-bf12-8bcbe44d452f-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (83b757f2-cb85-4b6e-b6f5-e306f2d37839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dd5a00-43d7-41f9-9660-bda540c2e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dd5a00-43d7-41f9-9660-bda540c2e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-231331059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd58cee-73f0-4e75-a5a5-6f2530263e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:10Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c358d-95b5-45f7-bd7a-ba2bf38b4f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655c358d-95b5-45f7-bd7a-ba2bf38b4f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91af4e32-cd5d-4a42-b321-654fe68e8312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91af4e32-cd5d-4a42-b321-654fe68e8312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd58cee-73f0-4e75-a5a5-6f2530263e80', 'volume_name': 'volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68456fc4-8ee2-4642-a091-9444a14d91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68456fc4-8ee2-4642-a091-9444a14d91bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dd36b5-23cf-49da-b5c1-c619cc63511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Volume 4fd58cee-73f0-4e75-a5a5-6f2530263e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80', 'volume_size': 1} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-231331059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd58cee-73f0-4e75-a5a5-6f2530263e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:10Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Creating volume 4fd58cee-73f0-4e75-a5a5-6f2530263e80 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:10 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:10 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 1073741824 Nov 03 18:31:10 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:11 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 1073741824" returned: 0 in 0.804s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:11 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 Nov 03 18:31:11 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:11 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80" returned: 0 in 0.370s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35dd36b5-23cf-49da-b5c1-c619cc63511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78033bf6-9f30-4dae-a909-dae712054d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Volume volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 (4fd58cee-73f0-4e75-a5a5-6f2530263e80): created successfully Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78033bf6-9f30-4dae-a909-dae712054d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (83b757f2-cb85-4b6e-b6f5-e306f2d37839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-83b7480e-1d8f-4591-a26d-949c33a53cb0 tempest-VolumesActionsTest-865860542 None] Created volume successfully. Nov 03 18:31:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-4fd58cee-73f0-4e75-a5a5-6f2530263e80-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-4fd58cee-73f0-4e75-a5a5-6f2530263e80-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-quobyte-4fd58cee-73f0-4e75-a5a5-6f2530263e80" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-4fd58cee-73f0-4e75-a5a5-6f2530263e80" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e35d6f-d23f-450b-bb0a-f29902992d5a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:12 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 Nov 03 18:31:12 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:13 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80" returned: 0 in 0.619s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:13 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80 Nov 03 18:31:13 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:13 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4fd58cee-73f0-4e75-a5a5-6f2530263e80" returned: 0 in 0.661s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-4fd58cee-73f0-4e75-a5a5-6f2530263e80" released by "delete_volume" :: held 1.360s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Created reservations ['5b38ceac-8d90-40b5-afd7-678c6ea74312', '70d82338-a880-4716-ad07-2df1bc3b40ac', '03e7aef2-f18d-48c6-bd1f-9bbd0d66bcc9', '47a5de4a-78a9-44e0-9d0e-47316ce922cf'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:14 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:31:14 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:14 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.441s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:31:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Deleted volume successfully. Nov 03 18:31:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-88130a32-2dd8-43e3-b2cb-b1261c7f7976 tempest-VolumesActionsTest-1462383193 None] Lock "cinder-4fd58cee-73f0-4e75-a5a5-6f2530263e80-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (e963e5c2-fd32-4824-82b5-8eb8199a3fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bf5936-0603-4f78-807f-9fc0b629b7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92bf5936-0603-4f78-807f-9fc0b629b7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200508484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231f9d46-1c93-440c-a490-6725a10ca463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:16Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2145e0-3a1e-41ec-aaff-462ffb6a8bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f2145e0-3a1e-41ec-aaff-462ffb6a8bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b45024-6df9-436d-b743-303526700518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b45024-6df9-436d-b743-303526700518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231f9d46-1c93-440c-a490-6725a10ca463', 'volume_name': 'volume-231f9d46-1c93-440c-a490-6725a10ca463', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359fd394-ce30-4623-863c-8646bb17ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359fd394-ce30-4623-863c-8646bb17ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b17ae78-dfb8-4264-bc39-c1118eaa27e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:15 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Volume 231f9d46-1c93-440c-a490-6725a10ca463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231f9d46-1c93-440c-a490-6725a10ca463', 'volume_size': 1} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200508484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231f9d46-1c93-440c-a490-6725a10ca463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:16Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Creating volume 231f9d46-1c93-440c-a490-6725a10ca463 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:15 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:15 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 1073741824 Nov 03 18:31:15 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:16 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 1073741824" returned: 0 in 0.632s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:16 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 Nov 03 18:31:16 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:16 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463" returned: 0 in 0.342s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b17ae78-dfb8-4264-bc39-c1118eaa27e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231f9d46-1c93-440c-a490-6725a10ca463', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc50f93-4bfc-48c1-9a9b-91d912619e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:16 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Volume volume-231f9d46-1c93-440c-a490-6725a10ca463 (231f9d46-1c93-440c-a490-6725a10ca463): created successfully Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc50f93-4bfc-48c1-9a9b-91d912619e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (e963e5c2-fd32-4824-82b5-8eb8199a3fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3fc5781d-f3c3-4159-8e1e-d8ca1660ba8e tempest-VolumesActionsTest-865860542 None] Created volume successfully. Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-231f9d46-1c93-440c-a490-6725a10ca463-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Lock "cinder-231f9d46-1c93-440c-a490-6725a10ca463-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Acquiring lock "cinder-quobyte-231f9d46-1c93-440c-a490-6725a10ca463" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-231f9d46-1c93-440c-a490-6725a10ca463" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1295aea6-cd10-4b5e-84b5-6058b192ea9e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:18 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 Nov 03 18:31:18 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:18 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463" returned: 0 in 0.569s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:18 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463 Nov 03 18:31:18 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:19 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-231f9d46-1c93-440c-a490-6725a10ca463" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Lock "cinder-quobyte-231f9d46-1c93-440c-a490-6725a10ca463" released by "delete_volume" :: held 0.968s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Created reservations ['c1a7668f-a959-4e99-bbf8-ad18f4bef3e1', 'a768107e-d735-4155-ae97-3c8eceac93ea', 'ecfe2746-974b-47e1-ad5d-501dbe05c56f', '0ea75cb5-b46f-461e-a743-70437b1a79a3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:19 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:31:19 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:19 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.326s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:31:19 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Deleted volume successfully. Nov 03 18:31:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7308eaa9-b26d-42b8-956a-27df47510fbc tempest-VolumesActionsTest-1462383193 None] Lock "cinder-231f9d46-1c93-440c-a490-6725a10ca463-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (fc6866e6-114c-4aa5-8178-ed15b20a99c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902ea617-9191-431a-81f8-8bbfc8c2beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902ea617-9191-431a-81f8-8bbfc8c2beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1045105998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65eab61b-50bf-4bcb-941c-138904fa64c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:21Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57292b65-3dfb-4347-bed8-471e11e15aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57292b65-3dfb-4347-bed8-471e11e15aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9599ae95-a94e-4d6e-b24f-8204710800e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9599ae95-a94e-4d6e-b24f-8204710800e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65eab61b-50bf-4bcb-941c-138904fa64c9', 'volume_name': 'volume-65eab61b-50bf-4bcb-941c-138904fa64c9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2bb7f4-4560-45fc-b50c-1f320c864365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2bb7f4-4560-45fc-b50c-1f320c864365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db95ebb-e1c5-4d91-aef0-d06942bbe87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:21 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Volume 65eab61b-50bf-4bcb-941c-138904fa64c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65eab61b-50bf-4bcb-941c-138904fa64c9', 'volume_size': 1} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1045105998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65eab61b-50bf-4bcb-941c-138904fa64c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c96f35b1b8040e5906609ea07b0ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:21Z,use_quota=True,user_id='4aa57ef4552f46ab824a4b8b8ef4133e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Creating volume 65eab61b-50bf-4bcb-941c-138904fa64c9 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:21 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:21 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 1073741824 Nov 03 18:31:21 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:22 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 1073741824" returned: 0 in 0.850s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:22 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 Nov 03 18:31:22 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:22 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9" returned: 0 in 0.531s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db95ebb-e1c5-4d91-aef0-d06942bbe87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65eab61b-50bf-4bcb-941c-138904fa64c9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a57d3c1-f08e-4676-bd70-b5af6576aeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:23 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Volume volume-65eab61b-50bf-4bcb-941c-138904fa64c9 (65eab61b-50bf-4bcb-941c-138904fa64c9): created successfully Nov 03 18:31:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a57d3c1-f08e-4676-bd70-b5af6576aeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Flow 'volume_create_manager' (fc6866e6-114c-4aa5-8178-ed15b20a99c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e189fc33-e8e6-49bc-b8a4-e395b45c51b7 tempest-VolumesActionsTest-865860542 None] Created volume successfully. Nov 03 18:31:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Acquiring lock "cinder-65eab61b-50bf-4bcb-941c-138904fa64c9-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Lock "cinder-65eab61b-50bf-4bcb-941c-138904fa64c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Acquiring lock "cinder-quobyte-65eab61b-50bf-4bcb-941c-138904fa64c9" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:31:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Lock "cinder-quobyte-65eab61b-50bf-4bcb-941c-138904fa64c9" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:31:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9106aaf-d720-49d0-8e9c-ebce902d6a32]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:25 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 Nov 03 18:31:25 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:25 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9" returned: 0 in 0.451s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:25 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9 Nov 03 18:31:25 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:25 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65eab61b-50bf-4bcb-941c-138904fa64c9" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Lock "cinder-quobyte-65eab61b-50bf-4bcb-941c-138904fa64c9" released by "delete_volume" :: held 0.795s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Created reservations ['4ba1557c-7933-498c-a9d3-4e267af71fda', '9e65d48c-17c8-4cce-8916-58ff2ae9a60f', '767ed245-5c6e-40f4-9e50-8640039bb821', 'c315fdca-3b4f-4cc1-963e-8e65af8ea19c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:25 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:31:25 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:26 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.308s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:26 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:31:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Deleted volume successfully. Nov 03 18:31:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4640e619-caac-46a8-8684-7234388b9fd8 tempest-VolumesActionsTest-865860542 None] Lock "cinder-65eab61b-50bf-4bcb-941c-138904fa64c9-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:31:35 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=91,cinder:UPDATE=105,cinder:DELETE=9,cinder:INSERT=24 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:31:36 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=108,cinder:SELECT=70,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Flow 'volume_create_manager' (09d92829-a5c6-4640-beeb-6858f5a04260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a75a5b-6f5b-464b-bb3e-e90f1b3c9b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a75a5b-6f5b-464b-bb3e-e90f1b3c9b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1759886507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b1af56-7b34-4182-8b80-a43fd8845e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7586d1be124bdbaefef94086e812b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:45Z,use_quota=True,user_id='b33f4a8edd994b398618bf8ed9d05463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da269bf-bb82-4b54-985b-406583f799c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da269bf-bb82-4b54-985b-406583f799c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06396eee-e618-455f-9800-d59f0d170a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06396eee-e618-455f-9800-d59f0d170a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b1af56-7b34-4182-8b80-a43fd8845e66', 'volume_name': 'volume-f2b1af56-7b34-4182-8b80-a43fd8845e66', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eb3fe9-68bc-4a5c-99c8-b004b352046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eb3fe9-68bc-4a5c-99c8-b004b352046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ffe493-4d23-43b8-85bf-451f4ce11370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Volume f2b1af56-7b34-4182-8b80-a43fd8845e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b1af56-7b34-4182-8b80-a43fd8845e66', 'volume_size': 1} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1759886507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b1af56-7b34-4182-8b80-a43fd8845e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7586d1be124bdbaefef94086e812b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:45Z,use_quota=True,user_id='b33f4a8edd994b398618bf8ed9d05463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Creating volume f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:45 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:45 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 1073741824 Nov 03 18:31:45 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:46 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 1073741824" returned: 0 in 0.611s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:46 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 Nov 03 18:31:46 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:46 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66" returned: 0 in 0.388s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ffe493-4d23-43b8-85bf-451f4ce11370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b1af56-7b34-4182-8b80-a43fd8845e66', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dbbab9-9a2a-4d4d-a0bf-9ee10ef0804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:46 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Volume volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 (f2b1af56-7b34-4182-8b80-a43fd8845e66): created successfully Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dbbab9-9a2a-4d4d-a0bf-9ee10ef0804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Flow 'volume_create_manager' (09d92829-a5c6-4640-beeb-6858f5a04260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8162bcbb-8219-4822-8a2b-069e67a4cbce tempest-TestStampPattern-1835977746 None] Created volume successfully. Nov 03 18:31:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-398dbfb2-c87c-426c-868a-73ba952aa9be req-9c84a08a-a608-40a0-a4f0-25d4482368ab tempest-AttachVolumeNegativeTest-1551287458 None] Terminate volume connection completed successfully. Nov 03 18:31:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-398dbfb2-c87c-426c-868a-73ba952aa9be req-9c84a08a-a608-40a0-a4f0-25d4482368ab tempest-AttachVolumeNegativeTest-1551287458 None] Deleting attachment 6a4faadb-8a4f-4957-b672-b2994744f107. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Flow 'volume_create_manager' (7459b4b6-343f-4c6f-a62f-5b91ad914109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacaa53d-e658-434a-b5bb-121aac1d2a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aacaa53d-e658-434a-b5bb-121aac1d2a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071211695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdbf409-9285-435b-a8c8-57e1892aeae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6aacfa857a42e3bd00345fd37a7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:47Z,use_quota=True,user_id='8269cdb2174a441c87512561cedf7d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a32cd07-5012-453c-863a-954942161bed),volume_type_id=9a32cd07-5012-453c-863a-954942161bed)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828af709-2eb6-47f3-92a0-4d6f1d1a966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828af709-2eb6-47f3-92a0-4d6f1d1a966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fb46c5-b5f6-4601-85a1-2a470dd3b4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fb46c5-b5f6-4601-85a1-2a470dd3b4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdbf409-9285-435b-a8c8-57e1892aeae7', 'volume_name': 'volume-9fdbf409-9285-435b-a8c8-57e1892aeae7', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c87ce-68ee-4c7a-bd1f-927a29513d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c87ce-68ee-4c7a-bd1f-927a29513d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192704b6-4e55-42cf-9fa1-0a5a9963fc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Volume 9fdbf409-9285-435b-a8c8-57e1892aeae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdbf409-9285-435b-a8c8-57e1892aeae7', 'volume_size': 1} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071211695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdbf409-9285-435b-a8c8-57e1892aeae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6aacfa857a42e3bd00345fd37a7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:47Z,use_quota=True,user_id='8269cdb2174a441c87512561cedf7d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a32cd07-5012-453c-863a-954942161bed),volume_type_id=9a32cd07-5012-453c-863a-954942161bed)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Creating volume 9fdbf409-9285-435b-a8c8-57e1892aeae7 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:47 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:47 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 1073741824 Nov 03 18:31:47 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Flow 'volume_create_manager' (8da4a2b8-8354-4acb-9cce-4f67293b3aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332390d-dca4-4b72-a4a9-78733b0638ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e332390d-dca4-4b72-a4a9-78733b0638ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-993071244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bb27ad-ac76-4c2f-9cb1-2b4a95238559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6aacfa857a42e3bd00345fd37a7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:48Z,use_quota=True,user_id='8269cdb2174a441c87512561cedf7d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e706dd69-d7bc-4195-a9e8-c9e05012a80e),volume_type_id=e706dd69-d7bc-4195-a9e8-c9e05012a80e)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32e644c-dba9-46c5-9e8f-6c56961e4a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32e644c-dba9-46c5-9e8f-6c56961e4a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3d9020-bab1-47cc-a73d-b9f951da7ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3d9020-bab1-47cc-a73d-b9f951da7ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bb27ad-ac76-4c2f-9cb1-2b4a95238559', 'volume_name': 'volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e44f9ed-60f1-4ee8-812b-bf5952de3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e44f9ed-60f1-4ee8-812b-bf5952de3aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dfef08-bdac-4b9a-8fec-913555bebb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:48 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Volume 61bb27ad-ac76-4c2f-9cb1-2b4a95238559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559', 'volume_size': 1} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:48 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 1073741824" returned: 0 in 0.906s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:48 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 Nov 03 18:31:48 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:49 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7" returned: 0 in 0.601s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.892s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-993071244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bb27ad-ac76-4c2f-9cb1-2b4a95238559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6aacfa857a42e3bd00345fd37a7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:48Z,use_quota=True,user_id='8269cdb2174a441c87512561cedf7d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e706dd69-d7bc-4195-a9e8-c9e05012a80e),volume_type_id=e706dd69-d7bc-4195-a9e8-c9e05012a80e)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Creating volume 61bb27ad-ac76-4c2f-9cb1-2b4a95238559 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:49 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192704b6-4e55-42cf-9fa1-0a5a9963fc53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdbf409-9285-435b-a8c8-57e1892aeae7', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:49 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 1073741824 Nov 03 18:31:49 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec6652-c3b5-4723-acbb-2faa7a703cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Volume volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 (9fdbf409-9285-435b-a8c8-57e1892aeae7): created successfully Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec6652-c3b5-4723-acbb-2faa7a703cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Flow 'volume_create_manager' (7459b4b6-343f-4c6f-a62f-5b91ad914109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d4caaad3-ec13-4a6c-943f-7cd80edb1e53 tempest-TestInstancesWithCinderVolumes-425655191 None] Created volume successfully. Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Flow 'volume_create_manager' (c5622e29-e8c9-443c-a880-26445ecca447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3171b5b0-f446-4b92-b537-ddc2cf9140c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3171b5b0-f446-4b92-b537-ddc2cf9140c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1560000264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1db37b-b11d-4224-a3e9-3d9b8e0ab073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6aacfa857a42e3bd00345fd37a7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:49Z,use_quota=True,user_id='8269cdb2174a441c87512561cedf7d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d63bbce-c513-49ba-9bdf-c4612b2b780d),volume_type_id=0d63bbce-c513-49ba-9bdf-c4612b2b780d)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eec461c-aa49-4e72-9b94-e505220c148d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eec461c-aa49-4e72-9b94-e505220c148d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd9fd91-713b-4663-bd33-c252b5ad0074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:49 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:31:50 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 1073741824" returned: 0 in 0.750s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:50 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 Nov 03 18:31:50 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd9fd91-713b-4663-bd33-c252b5ad0074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c1db37b-b11d-4224-a3e9-3d9b8e0ab073', 'volume_name': 'volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073', 'volume_size': 1, 'image_id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1241923237', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fd6aacfa857a42e3bd00345fd37a7c51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 31, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 31, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb/file', 'properties': {}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d6f333-c51e-4ae0-9c53-6199ba6a928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d6f333-c51e-4ae0-9c53-6199ba6a928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb323b3-96cf-4985-9208-fe310dcf7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Volume 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073', 'volume_size': 1, 'image_id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1241923237', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fd6aacfa857a42e3bd00345fd37a7c51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 31, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 31, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb/file', 'properties': {}}, 'image_service': } Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Trying to clone 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 from image 5c9452f5-5667-4bad-adf8-fbfcec8444bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:31:50 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559" returned: 0 in 0.448s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dfef08-bdac-4b9a-8fec-913555bebb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c497da76-dda3-4fbd-90f3-7a7ed4980ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:31:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Volume volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 (61bb27ad-ac76-4c2f-9cb1-2b4a95238559): created successfully Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c497da76-dda3-4fbd-90f3-7a7ed4980ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:31:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Flow 'volume_create_manager' (8da4a2b8-8354-4acb-9cce-4f67293b3aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:31:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-384fe063-5617-4f35-bbd6-df4d4f17f3eb tempest-TestInstancesWithCinderVolumes-425655191 None] Created volume successfully. Nov 03 18:31:55 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD, size 20.69 MB, duration 4.85 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:31:55 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Image download 20.69 MB at 4.27 MB/s Nov 03 18:31:55 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca7287-103b-4e4a-975e-94da00b236ef]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:55 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD Nov 03 18:31:55 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:56 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD" returned: 0 in 0.828s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Temporary image 5c9452f5-5667-4bad-adf8-fbfcec8444bb is fetched for user 8269cdb2174a441c87512561cedf7d92. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4311050d-8a2f-46da-8ef5-707acef9f5c3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:56 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD Nov 03 18:31:56 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:56 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD" returned: 0 in 0.499s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1560000264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c1db37b-b11d-4224-a3e9-3d9b8e0ab073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6aacfa857a42e3bd00345fd37a7c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:31:49Z,use_quota=True,user_id='8269cdb2174a441c87512561cedf7d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d63bbce-c513-49ba-9bdf-c4612b2b780d),volume_type_id=0d63bbce-c513-49ba-9bdf-c4612b2b780d)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Creating volume 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:31:56 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:31:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:56 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 1073741824 Nov 03 18:31:56 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:57 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 1073741824" returned: 0 in 0.840s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:57 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 Nov 03 18:31:57 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:58 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" returned: 0 in 0.436s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Attempting download of 5c9452f5-5667-4bad-adf8-fbfcec8444bb ((None, [{'url': 'file:///opt/stack/data/glance/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'metadata': {}}])) to volume 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f21ef-7f77-43e8-b8a5-8654a4d223e7]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:58 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6 Nov 03 18:31:58 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:58 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6" returned: 0 in 0.429s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:58 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6 Nov 03 18:31:58 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:59 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6" returned: 1 in 0.698s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5c9452f5-5667-4bad-adf8-fbfcec8444bb_cbucanx6' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ef81db-96ff-49fe-9dbb-7ca651302de4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:31:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:31:59 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:31:59 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:31:59 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD Nov 03 18:31:59 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:00 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD" returned: 0 in 0.577s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] 5c9452f5-5667-4bad-adf8-fbfcec8444bb was qcow2, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:00 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 Nov 03 18:32:00 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:00 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.591s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Flow 'volume_create_manager' (88fc4061-0416-45cb-a4a7-04500ac9ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be9dc5c-c1af-45ec-8ce0-b58a6f3c9958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9be9dc5c-c1af-45ec-8ce0-b58a6f3c9958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1423457825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff364218-f6e2-436f-aff2-758456ed6880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb93844da974946b56d11eb8f72d768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:01Z,use_quota=True,user_id='a57f7f799d354834ac2c724b1ccc8561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c83cd-102d-4e27-848b-3a279034500a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e26c83cd-102d-4e27-848b-3a279034500a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad6dc49-27a0-4b08-bd2e-65841a74d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad6dc49-27a0-4b08-bd2e-65841a74d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff364218-f6e2-436f-aff2-758456ed6880', 'volume_name': 'volume-ff364218-f6e2-436f-aff2-758456ed6880', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd91830-cd29-492d-8b2f-fbd10c4cd1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bd91830-cd29-492d-8b2f-fbd10c4cd1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdeaf31-83eb-4477-8901-542beeb8d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Volume ff364218-f6e2-436f-aff2-758456ed6880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff364218-f6e2-436f-aff2-758456ed6880', 'volume_size': 1} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1423457825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff364218-f6e2-436f-aff2-758456ed6880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb93844da974946b56d11eb8f72d768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:01Z,use_quota=True,user_id='a57f7f799d354834ac2c724b1ccc8561',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Creating volume ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:32:00 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:32:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:00 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 1073741824 Nov 03 18:32:00 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:01 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 1073741824" returned: 0 in 0.945s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:01 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 Nov 03 18:32:01 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:02 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880" returned: 0 in 0.491s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdeaf31-83eb-4477-8901-542beeb8d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff364218-f6e2-436f-aff2-758456ed6880', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacd3aa9-4e8b-40fc-956b-32aee1c3e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:02 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Volume volume-ff364218-f6e2-436f-aff2-758456ed6880 (ff364218-f6e2-436f-aff2-758456ed6880): created successfully Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacd3aa9-4e8b-40fc-956b-32aee1c3e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Flow 'volume_create_manager' (88fc4061-0416-45cb-a4a7-04500ac9ff41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a63bfbf6-e3e2-47f1-9820-9b53f0e77bef tempest-SnapshotMetadataTestJSON-1687628337 None] Created volume successfully. Nov 03 18:32:03 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" returned: 0 in 3.111s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5c9452f5-5667-4bad-adf8-fbfcec8444bb_7qa3vwz8devstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:32:03 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Converted 112.00 MB image at 35.99 MB/s Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:03 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 1G Nov 03 18:32:03 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Creating offline snapshot cc466df4-7624-4420-845e-f8a0c6db45bb of volume ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe9242-9f41-4465-b35c-187c03095cb5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:03 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 Nov 03 18:32:03 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:03 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 1G" returned: 0 in 0.648s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Downloaded image 5c9452f5-5667-4bad-adf8-fbfcec8444bb ((None, [{'url': 'file:///opt/stack/data/glance/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'metadata': {}}])) to volume 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Temporary image 5c9452f5-5667-4bad-adf8-fbfcec8444bb for user 8269cdb2174a441c87512561cedf7d92 is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Marking volume 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Copying metadata from image 5c9452f5-5667-4bad-adf8-fbfcec8444bb to 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:32:03 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Creating volume glance metadata for volume 5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 backed by image 5c9452f5-5667-4bad-adf8-fbfcec8444bb with: {'image_id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'image_name': 'tempest-scenario-img--1241923237', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:32:04 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880" returned: 0 in 0.761s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:04 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb 1G Nov 03 18:32:04 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb323b3-96cf-4985-9208-fe310dcf7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073', 'volume_size': 1, 'image_id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1241923237', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fd6aacfa857a42e3bd00345fd37a7c51', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5c9452f5-5667-4bad-adf8-fbfcec8444bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 31, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 31, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5c9452f5-5667-4bad-adf8-fbfcec8444bb/file', 'properties': {}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2739e522-4b63-4fbf-8afb-20f3aa6e90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Volume volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 (5c1db37b-b11d-4224-a3e9-3d9b8e0ab073): created successfully Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2739e522-4b63-4fbf-8afb-20f3aa6e90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Flow 'volume_create_manager' (c5622e29-e8c9-443c-a880-26445ecca447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-727504c9-e806-4055-94ea-5742eacfddd0 tempest-TestInstancesWithCinderVolumes-425655191 None] Created volume successfully. Nov 03 18:32:04 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb 1G" returned: 0 in 0.712s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff364218-f6e2-436f-aff2-758456ed6880 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:04 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff364218-f6e2-436f-aff2-758456ed6880 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb Nov 03 18:32:04 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:05 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff364218-f6e2-436f-aff2-758456ed6880 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb" returned: 0 in 0.433s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:05 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb is being set with open permissions: ugo+rw Nov 03 18:32:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:05 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb Nov 03 18:32:05 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:05 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb" returned: 0 in 0.379s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:05 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info Nov 03 18:32:05 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:06 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info" returned: 0 in 0.365s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:06 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info is being set with open permissions: ugo+rw Nov 03 18:32:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:06 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info Nov 03 18:32:06 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:06 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.info" returned: 0 in 0.419s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.252s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-17e56f35-5982-494b-b4c3-edfb4b44ab19 tempest-SnapshotMetadataTestJSON-1687628337 None] Create snapshot completed successfully Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "cinder-cc466df4-7624-4420-845e-f8a0c6db45bb-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-cc466df4-7624-4420-845e-f8a0c6db45bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "cinder-quobyte-ff364218-f6e2-436f-aff2-758456ed6880" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-quobyte-ff364218-f6e2-436f-aff2-758456ed6880" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "cinder-quobyte-cc466df4-7624-4420-845e-f8a0c6db45bb" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-quobyte-cc466df4-7624-4420-845e-f8a0c6db45bb" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Deleting offline snapshot cc466df4-7624-4420-845e-f8a0c6db45bb of volume ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] snapshot_file for this snap is: volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[657aacfb-4a2f-443e-a4be-d01ff1bd0a68]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:09 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb Nov 03 18:32:09 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:10 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb" returned: 0 in 0.891s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff364218-f6e2-436f-aff2-758456ed6880(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a896c8-4c2a-4731-a3e6-60823d95a987]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-f2732ca4-b95b-466d-a863-de07fcd09c49 req-e7b2ad11-30ff-4368-833d-bc9222e5a274 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-f2732ca4-b95b-466d-a863-de07fcd09c49 req-e7b2ad11-30ff-4368-833d-bc9222e5a274 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-f2732ca4-b95b-466d-a863-de07fcd09c49 req-e7b2ad11-30ff-4368-833d-bc9222e5a274 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-f2732ca4-b95b-466d-a863-de07fcd09c49 req-e7b2ad11-30ff-4368-833d-bc9222e5a274 tempest-TestInstancesWithCinderVolumes-425655191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f244333c-64e5-4031-bd24-97bae91db5fa', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:32:10 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 Nov 03 18:32:10 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-f2732ca4-b95b-466d-a863-de07fcd09c49 req-e7b2ad11-30ff-4368-833d-bc9222e5a274 tempest-TestInstancesWithCinderVolumes-425655191 None] attachment_update completed successfully. Nov 03 18:32:11 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880" returned: 0 in 0.940s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:11 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb Nov 03 18:32:11 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:12 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb" returned: 0 in 0.555s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:12 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb Nov 03 18:32:12 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:12 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880.cc466df4-7624-4420-845e-f8a0c6db45bb" returned: 0 in 0.339s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-quobyte-cc466df4-7624-4420-845e-f8a0c6db45bb" released by "_delete_snapshot" :: held 3.014s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-quobyte-ff364218-f6e2-436f-aff2-758456ed6880" released by "delete_snapshot" :: held 3.058s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Created reservations ['e0d69c20-c5da-41d6-8061-498fa1ce37f0', '3384f152-827d-4270-8791-81fbea1c9a9c', '3933e393-c193-44d4-b926-95869bf80af2', '0a55efb6-1da8-462c-ab04-619573d9d7d9'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:32:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Delete snapshot completed successfully. Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4b3e17b4-f677-49c3-995b-3f565e51ed56 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-cc466df4-7624-4420-845e-f8a0c6db45bb-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "cinder-ff364218-f6e2-436f-aff2-758456ed6880-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-ff364218-f6e2-436f-aff2-758456ed6880-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "cinder-quobyte-ff364218-f6e2-436f-aff2-758456ed6880" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-quobyte-ff364218-f6e2-436f-aff2-758456ed6880" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c1ad7-556c-4262-b927-4e5e5c4b427a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:13 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 Nov 03 18:32:13 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:13 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880" returned: 0 in 0.529s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:13 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880 Nov 03 18:32:13 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:13 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff364218-f6e2-436f-aff2-758456ed6880" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-quobyte-ff364218-f6e2-436f-aff2-758456ed6880" released by "delete_volume" :: held 0.911s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:13 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Created reservations ['5529b570-4bde-4b39-9472-0b28d745eecd', '87f82e3f-4b29-4734-bc95-1a6281122f2e', '516ed154-8281-4be4-9886-06ffe1863015', 'a9fea0da-2add-44c2-add6-33344b42da62'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:14 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:32:14 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:14 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.726s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:32:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Deleted volume successfully. Nov 03 18:32:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6a6f868d-5463-4203-b26a-9c428bcff860 tempest-SnapshotMetadataTestJSON-1687628337 None] Lock "cinder-ff364218-f6e2-436f-aff2-758456ed6880-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Flow 'volume_create_manager' (f9f5265e-e6b0-4a48-b3cc-78fd51598cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7f31f3-203e-4e00-8aad-20847cf1c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf7f31f3-203e-4e00-8aad-20847cf1c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-657755708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca50254-4f25-4f1f-97c3-0c09b81a7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff07b4608144be0938f854e4b9e550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:21Z,use_quota=True,user_id='dc4d0fee84e347e19a62634f96cca829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd014f38-31f7-4259-85b5-cf57d03dc399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd014f38-31f7-4259-85b5-cf57d03dc399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cfdc11-e869-4606-962b-d5880b918519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cfdc11-e869-4606-962b-d5880b918519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca50254-4f25-4f1f-97c3-0c09b81a7ca5', 'volume_name': 'volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ba61ec-77de-4979-a366-d8970a47ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13ba61ec-77de-4979-a366-d8970a47ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6fe028-5618-478d-95ed-3c69951c52ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Volume 6ca50254-4f25-4f1f-97c3-0c09b81a7ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5', 'volume_size': 1} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-657755708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca50254-4f25-4f1f-97c3-0c09b81a7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff07b4608144be0938f854e4b9e550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:21Z,use_quota=True,user_id='dc4d0fee84e347e19a62634f96cca829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Creating volume 6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:32:20 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:32:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:20 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 1073741824 Nov 03 18:32:20 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:21 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 1073741824" returned: 0 in 0.873s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:21 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:21 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:22 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.522s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6fe028-5618-478d-95ed-3c69951c52ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1a2ca6-f217-428a-b77e-cca4350ead43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:22 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Volume volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 (6ca50254-4f25-4f1f-97c3-0c09b81a7ca5): created successfully Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1a2ca6-f217-428a-b77e-cca4350ead43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Flow 'volume_create_manager' (f9f5265e-e6b0-4a48-b3cc-78fd51598cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f137e49e-f810-4580-9809-d74ab714e5ef tempest-VolumesDeleteCascade-1127360529 None] Created volume successfully. Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Creating offline snapshot 50ef0152-dde6-4699-9635-233d5aaddd56 of volume 6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f657b2c9-3d4d-4711-b604-5ab053da93bc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:23 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:23 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-7731cf8c-2796-49a1-be59-053546456d12 req-91078c17-3a30-4308-9b1b-aa443f60077a tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:23 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.766s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:23 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 1G Nov 03 18:32:23 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:24 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 1G" returned: 0 in 0.553s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:24 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:24 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:24 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.413s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:24 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 is being set with open permissions: ugo+rw Nov 03 18:32:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:24 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:24 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:25 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.323s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:25 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info Nov 03 18:32:25 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:25 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info" returned: 0 in 0.533s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:25 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info is being set with open permissions: ugo+rw Nov 03 18:32:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:25 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info Nov 03 18:32:25 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:26 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.info" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-7731cf8c-2796-49a1-be59-053546456d12 req-91078c17-3a30-4308-9b1b-aa443f60077a tempest-TestStampPattern-1835977746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.300s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-7731cf8c-2796-49a1-be59-053546456d12 req-91078c17-3a30-4308-9b1b-aa443f60077a tempest-TestStampPattern-1835977746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cc793eec-4d5e-4512-9257-81bd8d70944b tempest-VolumesDeleteCascade-1127360529 None] Create snapshot completed successfully Nov 03 18:32:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-7731cf8c-2796-49a1-be59-053546456d12 req-91078c17-3a30-4308-9b1b-aa443f60077a tempest-TestStampPattern-1835977746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-f2b1af56-7b34-4182-8b80-a43fd8845e66', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '272a554a-f93e-4589-8354-838dff4aaf13', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:32:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-7731cf8c-2796-49a1-be59-053546456d12 req-91078c17-3a30-4308-9b1b-aa443f60077a tempest-TestStampPattern-1835977746 None] attachment_update completed successfully. Nov 03 18:32:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Creating offline snapshot ba30f0ff-e53b-4741-85e5-9f695c59f824 of volume 6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:32:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d28c949-b86a-4513-9c9d-d96861987b5d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:27 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:27 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:28 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.405s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:28 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 1G Nov 03 18:32:28 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:28 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 1G" returned: 0 in 0.654s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:28 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 Nov 03 18:32:28 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:29 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:29 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 is being set with open permissions: ugo+rw Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:29 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 Nov 03 18:32:29 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:29 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f198ce2a-313d-40bb-a9b8-ea8a3a111692 tempest-VolumesDeleteCascade-1127360529 None] Create snapshot completed successfully Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Performing cascade delete. {{(pid=86841) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-50ef0152-dde6-4699-9635-233d5aaddd56-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-50ef0152-dde6-4699-9635-233d5aaddd56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-50ef0152-dde6-4699-9635-233d5aaddd56" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-50ef0152-dde6-4699-9635-233d5aaddd56" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Deleting offline snapshot 50ef0152-dde6-4699-9635-233d5aaddd56 of volume 6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] snapshot_file for this snap is: volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56598e5-71d7-4f11-b8c9-21d8a2dab862]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:30 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:30 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:30 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.424s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1967f5-7778-4117-8a3d-f0b4f8e0e33e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:30 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:30 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:30 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.439s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d35857-ab0b-4383-9228-a755c43ed1c9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:31 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 Nov 03 18:32:31 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:31 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824" returned: 0 in 0.406s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3344ef-b2fb-4a84-8815-522d53e61368]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:31 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:31 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:31 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.467s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f6c5d5-d349-42dd-a783-681db3a91561]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:32 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:32 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-4f444a30-8755-40bc-bf74-a99a2811f544 req-90c1cb6a-dc75-4daf-82ab-b4a7e525dcc9 tempest-TestStampPattern-1835977746 None] Terminate volume connection completed successfully. Nov 03 18:32:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-4f444a30-8755-40bc-bf74-a99a2811f544 req-90c1cb6a-dc75-4daf-82ab-b4a7e525dcc9 tempest-TestStampPattern-1835977746 None] Deleting attachment 272a554a-f93e-4589-8354-838dff4aaf13. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:32:32 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.506s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:32 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:32 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:32 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.368s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:32 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56 Nov 03 18:32:32 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:33 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.50ef0152-dde6-4699-9635-233d5aaddd56" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 -F qcow2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:33 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 -F qcow2 Nov 03 18:32:33 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Creating offline snapshot 297dc5b1-a6de-475f-afc9-da1ac389678b of volume f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc50a288-cc0f-4f43-ac04-95d4ff83b06b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:33 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 Nov 03 18:32:33 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:33 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 -F qcow2" returned: 0 in 0.420s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-50ef0152-dde6-4699-9635-233d5aaddd56" released by "_delete_snapshot" :: held 3.650s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" released by "delete_snapshot" :: held 3.671s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Created reservations ['b3751a51-0935-4c3e-bab6-58ccb8065a57', '350a5cc6-3d93-4aa7-9ec7-a50eb686e32e', '5f1505c9-e8ce-4cc5-8e64-02f651b7fe3d', 'fcd0c8fe-f1bc-4dd5-9643-a957f87feb57'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:32:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Delete snapshot completed successfully. Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-50ef0152-dde6-4699-9635-233d5aaddd56-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-ba30f0ff-e53b-4741-85e5-9f695c59f824-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-ba30f0ff-e53b-4741-85e5-9f695c59f824-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-ba30f0ff-e53b-4741-85e5-9f695c59f824" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-ba30f0ff-e53b-4741-85e5-9f695c59f824" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Deleting offline snapshot ba30f0ff-e53b-4741-85e5-9f695c59f824 of volume 6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] snapshot_file for this snap is: volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:32:33 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66" returned: 0 in 0.618s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fe0b45-b3a5-4710-9698-52e2d6d70fbd]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:33 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b 1G Nov 03 18:32:33 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:34 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 Nov 03 18:32:34 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Flow 'volume_create_manager' (701374f7-757a-4c53-93be-1259a21516f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123fcf1d-c84f-4736-8de9-1b91f3a3d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123fcf1d-c84f-4736-8de9-1b91f3a3d41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-562481462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60932dd8-dd93-4679-86cd-8e3695c79b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5639e891332048349c73a62acf754c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:34Z,use_quota=True,user_id='124955aee72f4b5aaf34b5f51a01d2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bcba11-c695-49fb-8b7f-f9a2f9a025f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bcba11-c695-49fb-8b7f-f9a2f9a025f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00bd9ea-d3fe-4b80-ad1c-10b89414f5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00bd9ea-d3fe-4b80-ad1c-10b89414f5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60932dd8-dd93-4679-86cd-8e3695c79b08', 'volume_name': 'volume-60932dd8-dd93-4679-86cd-8e3695c79b08', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0c7c54-d858-419f-acde-d0cd71345014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0c7c54-d858-419f-acde-d0cd71345014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc52c72-ca25-4fe2-969d-6236eeaa8d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Volume 60932dd8-dd93-4679-86cd-8e3695c79b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60932dd8-dd93-4679-86cd-8e3695c79b08', 'volume_size': 1} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:34 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824" returned: 0 in 0.430s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[00476f34-d0a4-4038-823f-0a39748a2c66]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:34 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b 1G" returned: 0 in 0.540s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:34 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b Nov 03 18:32:34 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:34 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:34 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:34 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:34 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b" returned: 0 in 0.355s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:34 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b is being set with open permissions: ugo+rw Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.421s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:34 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b Nov 03 18:32:34 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:34 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 Nov 03 18:32:34 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:35 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b" returned: 0 in 0.291s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:35 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info Nov 03 18:32:35 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:35 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824" returned: 0 in 0.434s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:35 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824 Nov 03 18:32:35 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:35 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info" returned: 0 in 0.318s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:35 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info is being set with open permissions: ugo+rw Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:35 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info Nov 03 18:32:35 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:35 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5.ba30f0ff-e53b-4741-85e5-9f695c59f824" returned: 0 in 0.314s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-ba30f0ff-e53b-4741-85e5-9f695c59f824" released by "_delete_snapshot" :: held 1.764s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" released by "delete_snapshot" :: held 1.798s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Created reservations ['33c6b7e5-fde2-49a6-803a-48c86b689f99', '7cae4946-3278-47cf-976e-55bbc23882c7', 'df949f75-45b0-4e37-a24c-0155e11043da', '1500724b-d798-422e-8162-d1d04593d777'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:32:35 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.info" returned: 0 in 0.313s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-562481462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60932dd8-dd93-4679-86cd-8e3695c79b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5639e891332048349c73a62acf754c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:34Z,use_quota=True,user_id='124955aee72f4b5aaf34b5f51a01d2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Creating volume 60932dd8-dd93-4679-86cd-8e3695c79b08 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:32:35 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:35 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 1073741824 Nov 03 18:32:35 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=68,cinder:UPDATE=44,cinder:INSERT=18,cinder:DELETE=7 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:32:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Delete snapshot completed successfully. Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-ba30f0ff-e53b-4741-85e5-9f695c59f824-delete_snapshot" released by "delete_snapshot" :: held 2.123s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Snapshots deleted, issuing volume delete {{(pid=86841) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8687eb3f-b5aa-488f-ac88-7ad7ab104e30 tempest-TestStampPattern-1835977746 None] Create snapshot completed successfully Nov 03 18:32:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" acquired by "delete_volume" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5b4092-c349-4412-891c-24abf78add01]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:36 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:36 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:36 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 1073741824" returned: 0 in 0.587s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=63,cinder:SELECT=70,cinder:INSERT=16,cinder:DELETE=3 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:36 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 Nov 03 18:32:36 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:36 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.489s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:36 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5 Nov 03 18:32:36 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:36 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08" returned: 0 in 0.246s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc52c72-ca25-4fe2-969d-6236eeaa8d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60932dd8-dd93-4679-86cd-8e3695c79b08', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c5dd07-5c06-4037-bf6a-2ca0074d27ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:36 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Volume volume-60932dd8-dd93-4679-86cd-8e3695c79b08 (60932dd8-dd93-4679-86cd-8e3695c79b08): created successfully Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92c5dd07-5c06-4037-bf6a-2ca0074d27ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Flow 'volume_create_manager' (701374f7-757a-4c53-93be-1259a21516f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:36 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" returned: 0 in 0.332s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:36 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-da4899bd-a0f0-43ae-a9c8-3e58bf7f1560 tempest-AttachVolumeNegativeTest-1551287458 None] Created volume successfully. Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5" released by "delete_volume" :: held 0.906s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Created reservations ['be97e879-0b28-41cb-9a67-dcf1d8710ea7', '80f76c09-3355-4b4a-8b20-f847f41da2af', 'b43da177-58e4-43e7-a2fb-bd23a2bc96fc', '44d2a01f-6817-4f30-808b-4e1c2be8d955'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:37 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:32:37 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:37 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:32:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Deleted volume successfully. Nov 03 18:32:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e35da98f-2246-4518-aef2-7152adacb4ca tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-6ca50254-4f25-4f1f-97c3-0c09b81a7ca5-delete_volume" released by "delete_volume" :: held 7.461s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Flow 'volume_create_manager' (8fc0d805-73c1-4876-93e4-ef61d805193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48cc606-aa6e-4e86-b4e2-d48796294612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48cc606-aa6e-4e86-b4e2-d48796294612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1171016137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a6ccda-c971-4780-bfb5-e4deb05b5874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff07b4608144be0938f854e4b9e550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:38Z,use_quota=True,user_id='dc4d0fee84e347e19a62634f96cca829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8d722e-a923-475e-acbb-c9a880616b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8d722e-a923-475e-acbb-c9a880616b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4f9ae5-4e6b-45cf-95ac-c30bce76754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4f9ae5-4e6b-45cf-95ac-c30bce76754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a6ccda-c971-4780-bfb5-e4deb05b5874', 'volume_name': 'volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe48a41-ea40-4482-8925-6cbbfdbc9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe48a41-ea40-4482-8925-6cbbfdbc9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdf1678-749b-436d-a95a-7a3084b2a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:38 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Volume b9a6ccda-c971-4780-bfb5-e4deb05b5874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874', 'volume_size': 1} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1171016137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a6ccda-c971-4780-bfb5-e4deb05b5874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff07b4608144be0938f854e4b9e550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:38Z,use_quota=True,user_id='dc4d0fee84e347e19a62634f96cca829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Creating volume b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:32:38 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-1f9d17fc-ec69-4730-9b26-41424a8d708b req-a9ce4f0a-732b-419b-9bad-312fadf86320 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:38 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 1073741824 Nov 03 18:32:38 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:38 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 1073741824" returned: 0 in 0.451s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:38 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 Nov 03 18:32:38 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:39 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874" returned: 0 in 0.239s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-1f9d17fc-ec69-4730-9b26-41424a8d708b req-a9ce4f0a-732b-419b-9bad-312fadf86320 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.704s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdf1678-749b-436d-a95a-7a3084b2a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae49feb-306a-493d-83dc-0fd67fc59b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-1f9d17fc-ec69-4730-9b26-41424a8d708b req-a9ce4f0a-732b-419b-9bad-312fadf86320 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:39 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Volume volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 (b9a6ccda-c971-4780-bfb5-e4deb05b5874): created successfully Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae49feb-306a-493d-83dc-0fd67fc59b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Flow 'volume_create_manager' (8fc0d805-73c1-4876-93e4-ef61d805193e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:39 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-472627b0-820c-407f-84bc-36058a83dfc3 tempest-VolumesDeleteCascade-1127360529 None] Created volume successfully. Nov 03 18:32:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-1f9d17fc-ec69-4730-9b26-41424a8d708b req-a9ce4f0a-732b-419b-9bad-312fadf86320 tempest-AttachVolumeNegativeTest-1551287458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-60932dd8-dd93-4679-86cd-8e3695c79b08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e42a15eb-b154-41bc-b580-3718b99585cc', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:32:39 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-1f9d17fc-ec69-4730-9b26-41424a8d708b req-a9ce4f0a-732b-419b-9bad-312fadf86320 tempest-AttachVolumeNegativeTest-1551287458 None] attachment_update completed successfully. Nov 03 18:32:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Creating offline snapshot 3fa0cffd-0e55-4b22-b786-285a8d5770ce of volume b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:32:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[47724af5-74b7-4d2d-a242-3c07549c9fe6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:40 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 Nov 03 18:32:40 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:41 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874" returned: 0 in 0.417s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:41 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce 1G Nov 03 18:32:41 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-bdc5e515-38b8-4b27-94d3-d0673386751f req-feef86eb-3c53-4ea6-953a-b04e0215cd3b tempest-AttachVolumeNegativeTest-1551287458 None] Terminate volume connection completed successfully. Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-bdc5e515-38b8-4b27-94d3-d0673386751f req-feef86eb-3c53-4ea6-953a-b04e0215cd3b tempest-AttachVolumeNegativeTest-1551287458 None] Deleting attachment e42a15eb-b154-41bc-b580-3718b99585cc. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:32:41 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce 1G" returned: 0 in 0.457s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:41 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce Nov 03 18:32:41 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:41 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce" returned: 0 in 0.316s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:41 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce is being set with open permissions: ugo+rw Nov 03 18:32:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:41 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce Nov 03 18:32:41 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:42 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce" returned: 0 in 0.275s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:42 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info Nov 03 18:32:42 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:42 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info" returned: 0 in 0.319s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:42 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info is being set with open permissions: ugo+rw Nov 03 18:32:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:42 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info Nov 03 18:32:42 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:42 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.info" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4faf0a87-f51f-46f8-835f-67a7c7ec7865 tempest-VolumesDeleteCascade-1127360529 None] Create snapshot completed successfully Nov 03 18:32:44 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:32:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Flow 'volume_create_manager' (fcd6e902-15b9-430c-a486-1d1c450e3075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5ca27c-5b55-4b3a-bd9f-3ade38b207b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5ca27c-5b55-4b3a-bd9f-3ade38b207b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1365469477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee78312-fc07-4b38-a40d-19dcc3f885a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff07b4608144be0938f854e4b9e550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fa0cffd-0e55-4b22-b786-285a8d5770ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:45Z,use_quota=True,user_id='dc4d0fee84e347e19a62634f96cca829',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c8423e-9c1e-4537-abef-8179da848f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c8423e-9c1e-4537-abef-8179da848f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5c62fa-c505-43cc-b07c-2f366151f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5c62fa-c505-43cc-b07c-2f366151f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ee78312-fc07-4b38-a40d-19dcc3f885a8', 'volume_name': 'volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8', 'volume_size': 1, 'snapshot_id': '3fa0cffd-0e55-4b22-b786-285a8d5770ce'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8743a55-ad40-4989-b43b-6f54a4090e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8743a55-ad40-4989-b43b-6f54a4090e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12901ab9-ecbe-4732-af03-23ca1bd1eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Volume 0ee78312-fc07-4b38-a40d-19dcc3f885a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8', 'volume_size': 1, 'snapshot_id': '3fa0cffd-0e55-4b22-b786-285a8d5770ce'} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-3fa0cffd-0e55-4b22-b786-285a8d5770ce-0ee78312-fc07-4b38-a40d-19dcc3f885a8" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-3fa0cffd-0e55-4b22-b786-285a8d5770ce-0ee78312-fc07-4b38-a40d-19dcc3f885a8" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Creating volume 0ee78312-fc07-4b38-a40d-19dcc3f885a8 from snapshot 3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-0ee78312-fc07-4b38-a40d-19dcc3f885a8" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-0ee78312-fc07-4b38-a40d-19dcc3f885a8" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] snapshot: 3fa0cffd-0e55-4b22-b786-285a8d5770ce, volume: 0ee78312-fc07-4b38-a40d-19dcc3f885a8, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Flow 'volume_create_manager' (2ffa54dd-15db-451c-9fce-f214263a759a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72af8c6b-a766-42c6-9ee7-f5e83bea196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72af8c6b-a766-42c6-9ee7-f5e83bea196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1438922065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c50da-d6fb-4c1a-92d8-0e931902ef09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7586d1be124bdbaefef94086e812b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=297dc5b1-a6de-475f-afc9-da1ac389678b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:32:45Z,use_quota=True,user_id='b33f4a8edd994b398618bf8ed9d05463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59497f79-8c53-4068-a418-f5fa8e25c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59497f79-8c53-4068-a418-f5fa8e25c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee82d35-d4da-46e8-8bb5-3ecbbc845097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee82d35-d4da-46e8-8bb5-3ecbbc845097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '177c50da-d6fb-4c1a-92d8-0e931902ef09', 'volume_name': 'volume-177c50da-d6fb-4c1a-92d8-0e931902ef09', 'volume_size': 1, 'snapshot_id': '297dc5b1-a6de-475f-afc9-da1ac389678b'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc050fe-f293-4291-a4f2-c51736eddf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc050fe-f293-4291-a4f2-c51736eddf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2f2f2c-b51a-4fc3-9133-87f4c16ee147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Volume 177c50da-d6fb-4c1a-92d8-0e931902ef09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-177c50da-d6fb-4c1a-92d8-0e931902ef09', 'volume_size': 1, 'snapshot_id': '297dc5b1-a6de-475f-afc9-da1ac389678b'} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64cd539-4e5f-4029-bf90-6a64d7c79cf7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:45 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce Nov 03 18:32:45 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:45 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce" returned: 0 in 0.397s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4182752-e401-457a-a442-4274cb867e51]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:45 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 Nov 03 18:32:45 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:46 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874" returned: 0 in 0.447s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:32:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:32:46 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:32:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:46 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 Nov 03 18:32:46 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-f25469ea-ba50-4c5a-b2c1-603e7df06113 req-27acb8d3-1014-493a-bd5f-12619a42523c tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8" returned: 0 in 9.564s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:55 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874, size 1024.00 MB, duration 9.56 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:32:55 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Converted 1024.00 MB image at 107.06 MB/s Nov 03 18:32:55 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 is being set with open permissions: ugo+rw Nov 03 18:32:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:55 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 Nov 03 18:32:55 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:56 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-0ee78312-fc07-4b38-a40d-19dcc3f885a8" released by "_copy_volume_from_snapshot" :: held 11.076s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-3fa0cffd-0e55-4b22-b786-285a8d5770ce-0ee78312-fc07-4b38-a40d-19dcc3f885a8" released by "_create_volume_from_snapshot" :: held 11.194s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.246s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.941s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-quobyte-297dc5b1-a6de-475f-afc9-da1ac389678b-177c50da-d6fb-4c1a-92d8-0e931902ef09" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12901ab9-ecbe-4732-af03-23ca1bd1eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8', 'volume_size': 1, 'snapshot_id': '3fa0cffd-0e55-4b22-b786-285a8d5770ce'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de72c904-f584-41a0-8e40-52d8c6ccaa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-297dc5b1-a6de-475f-afc9-da1ac389678b-177c50da-d6fb-4c1a-92d8-0e931902ef09" acquired by "_create_volume_from_snapshot" :: waited 0.109s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Creating volume 177c50da-d6fb-4c1a-92d8-0e931902ef09 from snapshot 297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-quobyte-177c50da-d6fb-4c1a-92d8-0e931902ef09" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Volume volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 (0ee78312-fc07-4b38-a40d-19dcc3f885a8): created successfully Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de72c904-f584-41a0-8e40-52d8c6ccaa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Flow 'volume_create_manager' (fcd6e902-15b9-430c-a486-1d1c450e3075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-177c50da-d6fb-4c1a-92d8-0e931902ef09" acquired by "_copy_volume_from_snapshot" :: waited 0.082s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] snapshot: 297dc5b1-a6de-475f-afc9-da1ac389678b, volume: 177c50da-d6fb-4c1a-92d8-0e931902ef09, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:32:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a4ab5d8f-2aea-4a39-b52c-7124c69b9aa5 tempest-VolumesDeleteCascade-1127360529 None] Created volume successfully. Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b329c3-0bf0-4d69-aa60-8441466e2fb6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:56 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b Nov 03 18:32:56 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:57 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b" returned: 0 in 0.478s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b1af56-7b34-4182-8b80-a43fd8845e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[338b98e9-b174-4f70-943a-af5e8acd7ae3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-b9a6ccda-c971-4780-bfb5-e4deb05b5874-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:57 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 Nov 03 18:32:57 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-b9a6ccda-c971-4780-bfb5-e4deb05b5874-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Performing cascade delete. {{(pid=86841) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-3fa0cffd-0e55-4b22-b786-285a8d5770ce-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-3fa0cffd-0e55-4b22-b786-285a8d5770ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-b9a6ccda-c971-4780-bfb5-e4deb05b5874" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-b9a6ccda-c971-4780-bfb5-e4deb05b5874" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-3fa0cffd-0e55-4b22-b786-285a8d5770ce" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-3fa0cffd-0e55-4b22-b786-285a8d5770ce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Deleting offline snapshot 3fa0cffd-0e55-4b22-b786-285a8d5770ce of volume b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] snapshot_file for this snap is: volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[66792c8a-46a5-4560-b454-c55c67ca5308]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:57 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66" returned: 0 in 0.692s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:32:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:57 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 Nov 03 18:32:57 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:58 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce Nov 03 18:32:58 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:58 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Nov 03 18:32:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce" returned: 0 in 0.745s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:32:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:32:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe6cff-a9ec-411d-88b6-695d70cb8484]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:32:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:58 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 Nov 03 18:32:58 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:32:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:32:59 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:32:59 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:00 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874" returned: 0 in 1.676s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:00 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce Nov 03 18:33:00 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:00 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.994s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:33:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:33:01 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce" returned: 0 in 1.181s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:01 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce Nov 03 18:33:01 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:02 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874.3fa0cffd-0e55-4b22-b786-285a8d5770ce" returned: 0 in 0.768s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-3fa0cffd-0e55-4b22-b786-285a8d5770ce" released by "_delete_snapshot" :: held 4.630s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-b9a6ccda-c971-4780-bfb5-e4deb05b5874" released by "delete_snapshot" :: held 4.672s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Created reservations ['fa7b79f5-7c50-44e7-9abf-473c48936153', '5afae264-019e-4bd0-97c3-6e933fc1358c', '2f5fb03e-ab9e-4a5a-8449-feffaaee5f92', '965abcbd-8be7-451c-9f76-ae1e460b1d85'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Delete snapshot completed successfully. Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-3fa0cffd-0e55-4b22-b786-285a8d5770ce-delete_snapshot" released by "delete_snapshot" :: held 5.144s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Snapshots deleted, issuing volume delete {{(pid=86841) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-b9a6ccda-c971-4780-bfb5-e4deb05b5874" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-b9a6ccda-c971-4780-bfb5-e4deb05b5874" acquired by "delete_volume" :: waited 0.054s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6f6a5-95b7-4329-af55-013710180928]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:03 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 Nov 03 18:33:03 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:04 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874" returned: 0 in 1.497s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:04 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874 Nov 03 18:33:04 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:05 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b9a6ccda-c971-4780-bfb5-e4deb05b5874" returned: 0 in 0.773s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-b9a6ccda-c971-4780-bfb5-e4deb05b5874" released by "delete_volume" :: held 2.485s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:05 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Created reservations ['b09f47bd-62d6-46c1-bbdc-a9635757dbb7', '59025679-7c7c-4c7d-81f4-29440420a078', '9ae85d7a-77e7-478e-9d14-ce720a6b49ba', '8253b9d8-68c0-4a12-b778-3d59a37555a1'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:06 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:06 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-0ee78312-fc07-4b38-a40d-19dcc3f885a8-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-0ee78312-fc07-4b38-a40d-19dcc3f885a8-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "cinder-quobyte-0ee78312-fc07-4b38-a40d-19dcc3f885a8" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-0ee78312-fc07-4b38-a40d-19dcc3f885a8" acquired by "delete_volume" :: waited 0.043s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:07 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 1.420s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Deleted volume successfully. Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cda432-ac0f-43e0-8435-3800c7385bd7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-35ebaf12-fde3-458f-8a10-eda34110f6fa tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-b9a6ccda-c971-4780-bfb5-e4deb05b5874-delete_volume" released by "delete_volume" :: held 9.958s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:07 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 Nov 03 18:33:07 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:09 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8" returned: 0 in 1.606s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:09 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8 Nov 03 18:33:09 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:09 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ee78312-fc07-4b38-a40d-19dcc3f885a8" returned: 0 in 0.921s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-quobyte-0ee78312-fc07-4b38-a40d-19dcc3f885a8" released by "delete_volume" :: held 2.775s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Created reservations ['3c358128-ddce-4acc-a136-881f5d2cf6c5', '50c5a795-433a-4427-88e9-3150de8f2d13', 'f18280fd-b420-4723-a944-1fe9b518535d', '2f413743-2d87-4544-a8f4-60b8cd3d2f13'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:10 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:10 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:11 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 1.146s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:11 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Deleted volume successfully. Nov 03 18:33:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-53bbd0d3-285f-4a83-a072-a5c34d9b8d63 tempest-VolumesDeleteCascade-1127360529 None] Lock "cinder-0ee78312-fc07-4b38-a40d-19dcc3f885a8-delete_volume" released by "delete_volume" :: held 4.885s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:12 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09" returned: 0 in 14.933s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:12 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66, size 1024.00 MB, duration 14.93 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:33:12 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Converted 1024.00 MB image at 68.57 MB/s Nov 03 18:33:12 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 is being set with open permissions: ugo+rw Nov 03 18:33:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:12 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 Nov 03 18:33:12 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:13 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09" returned: 0 in 0.393s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-177c50da-d6fb-4c1a-92d8-0e931902ef09" released by "_copy_volume_from_snapshot" :: held 16.649s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-297dc5b1-a6de-475f-afc9-da1ac389678b-177c50da-d6fb-4c1a-92d8-0e931902ef09" released by "_create_volume_from_snapshot" :: held 16.823s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.935s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-f25469ea-ba50-4c5a-b2c1-603e7df06113 req-27acb8d3-1014-493a-bd5f-12619a42523c tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 22.660s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-f25469ea-ba50-4c5a-b2c1-603e7df06113 req-27acb8d3-1014-493a-bd5f-12619a42523c tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2f2f2c-b51a-4fc3-9133-87f4c16ee147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177c50da-d6fb-4c1a-92d8-0e931902ef09', 'volume_size': 1, 'snapshot_id': '297dc5b1-a6de-475f-afc9-da1ac389678b'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bb68e3-ff14-479b-bf62-c2c5f3215318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Volume volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 (177c50da-d6fb-4c1a-92d8-0e931902ef09): created successfully Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67bb68e3-ff14-479b-bf62-c2c5f3215318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Flow 'volume_create_manager' (2ffa54dd-15db-451c-9fce-f214263a759a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-f25469ea-ba50-4c5a-b2c1-603e7df06113 req-27acb8d3-1014-493a-bd5f-12619a42523c tempest-TestInstancesWithCinderVolumes-425655191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-9fdbf409-9285-435b-a8c8-57e1892aeae7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e211696b-8911-4753-84e1-52ae8759ee0d', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:33:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d50d5372-9fa6-4415-8e1f-f561bc81f167 tempest-TestStampPattern-1835977746 None] Created volume successfully. Nov 03 18:33:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-f25469ea-ba50-4c5a-b2c1-603e7df06113 req-27acb8d3-1014-493a-bd5f-12619a42523c tempest-TestInstancesWithCinderVolumes-425655191 None] attachment_update completed successfully. Nov 03 18:33:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-252d7c8b-a922-4f25-8b3c-34d35c39b4e2 req-58e54ae9-72c6-4f82-aaac-924824b33bf0 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-252d7c8b-a922-4f25-8b3c-34d35c39b4e2 req-58e54ae9-72c6-4f82-aaac-924824b33bf0 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-252d7c8b-a922-4f25-8b3c-34d35c39b4e2 req-58e54ae9-72c6-4f82-aaac-924824b33bf0 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-252d7c8b-a922-4f25-8b3c-34d35c39b4e2 req-58e54ae9-72c6-4f82-aaac-924824b33bf0 tempest-TestInstancesWithCinderVolumes-425655191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef1721e0-ff9a-4693-b0f5-9d6917109ef7', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:33:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-252d7c8b-a922-4f25-8b3c-34d35c39b4e2 req-58e54ae9-72c6-4f82-aaac-924824b33bf0 tempest-TestInstancesWithCinderVolumes-425655191 None] attachment_update completed successfully. Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Flow 'volume_create_manager' (fb2d7209-8e44-4672-bba0-a5fdb4cf5f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e648a4-b294-42e3-bd54-61b0f2ae9b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e648a4-b294-42e3-bd54-61b0f2ae9b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1452555404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57bf690-9685-4a7d-b74f-1797d6a643a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e9ed5e2888469bb95bc05338904776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:17Z,use_quota=True,user_id='e59e0ae0531040b4985b5d7ebaaab4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118b99e7-857f-4e49-b840-f508e31f96e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118b99e7-857f-4e49-b840-f508e31f96e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb235bf4-eaed-4185-8244-66def2dace9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb235bf4-eaed-4185-8244-66def2dace9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57bf690-9685-4a7d-b74f-1797d6a643a0', 'volume_name': 'volume-b57bf690-9685-4a7d-b74f-1797d6a643a0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6127a2cc-63e9-4bb8-8de7-26493e0f6e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6127a2cc-63e9-4bb8-8de7-26493e0f6e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cc9c46-605d-417b-975b-6001a987f205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:17 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Volume b57bf690-9685-4a7d-b74f-1797d6a643a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57bf690-9685-4a7d-b74f-1797d6a643a0', 'volume_size': 1} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1452555404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57bf690-9685-4a7d-b74f-1797d6a643a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66e9ed5e2888469bb95bc05338904776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:17Z,use_quota=True,user_id='e59e0ae0531040b4985b5d7ebaaab4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Creating volume b57bf690-9685-4a7d-b74f-1797d6a643a0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:17 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:17 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 1073741824 Nov 03 18:33:17 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:17 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 1073741824" returned: 0 in 0.473s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:18 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 Nov 03 18:33:18 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:18 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0" returned: 0 in 0.315s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cc9c46-605d-417b-975b-6001a987f205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57bf690-9685-4a7d-b74f-1797d6a643a0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1568e39-cfd8-4272-bb9f-731d9fff7561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:18 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Volume volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 (b57bf690-9685-4a7d-b74f-1797d6a643a0): created successfully Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1568e39-cfd8-4272-bb9f-731d9fff7561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Flow 'volume_create_manager' (fb2d7209-8e44-4672-bba0-a5fdb4cf5f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-acb258eb-c75c-4818-8574-7be3f5acc2c7 tempest-VolumesMetadataTest-58873593 None] Created volume successfully. Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Acquiring lock "cinder-b57bf690-9685-4a7d-b74f-1797d6a643a0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Lock "cinder-b57bf690-9685-4a7d-b74f-1797d6a643a0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Acquiring lock "cinder-quobyte-b57bf690-9685-4a7d-b74f-1797d6a643a0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Lock "cinder-quobyte-b57bf690-9685-4a7d-b74f-1797d6a643a0" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab2c95e-bd6a-4d12-a93f-0e8772b3eea9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:20 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 Nov 03 18:33:20 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:20 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0" returned: 0 in 0.413s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:20 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0 Nov 03 18:33:20 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:21 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b57bf690-9685-4a7d-b74f-1797d6a643a0" returned: 0 in 0.282s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:21 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-de60876b-e380-436d-bf0f-906ad29e0af2 req-c4176468-58ee-44ae-ac86-b38dbbcd075c tempest-TestInstancesWithCinderVolumes-425655191 None] Terminate volume connection completed successfully. Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-de60876b-e380-436d-bf0f-906ad29e0af2 req-c4176468-58ee-44ae-ac86-b38dbbcd075c tempest-TestInstancesWithCinderVolumes-425655191 None] Deleting attachment e211696b-8911-4753-84e1-52ae8759ee0d. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Lock "cinder-quobyte-b57bf690-9685-4a7d-b74f-1797d6a643a0" released by "delete_volume" :: held 0.753s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Created reservations ['23b129b0-e5a8-4855-9ad3-1e739b47c8f5', '8ed79670-7d00-4729-8e0f-1ad89e3d7bdc', 'd4877b3e-0ad1-40bc-8f44-176c3fde1a72', 'a4e08b15-2ccc-47cf-9365-b997455ce6e0'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:21 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:21 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:21 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.315s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:21 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Deleted volume successfully. Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8326bc4b-ff3e-4336-b08b-71f32b5f37ff tempest-VolumesMetadataTest-58873593 None] Lock "cinder-b57bf690-9685-4a7d-b74f-1797d6a643a0-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "cinder-9fdbf409-9285-435b-a8c8-57e1892aeae7-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-9fdbf409-9285-435b-a8c8-57e1892aeae7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "cinder-quobyte-9fdbf409-9285-435b-a8c8-57e1892aeae7" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-quobyte-9fdbf409-9285-435b-a8c8-57e1892aeae7" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fd5e49-2a3a-4dae-a97d-24aefb7c2290]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:22 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 Nov 03 18:33:22 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:22 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7" returned: 0 in 0.633s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:22 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7 Nov 03 18:33:22 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:23 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9fdbf409-9285-435b-a8c8-57e1892aeae7" returned: 0 in 0.352s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-quobyte-9fdbf409-9285-435b-a8c8-57e1892aeae7" released by "delete_volume" :: held 1.078s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:23 devstack cinder-volume[86841]: WARNING cinder.quota [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1769334472-783745810 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1769334472-783745810, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:33:23 devstack cinder-volume[86841]: WARNING cinder.quota [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1769334472-783745810 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1769334472-783745810, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Created reservations ['a88280d9-0646-4dff-9d88-35e6bdeb3778', 'b94acf6f-17bf-4419-9dca-c8ecc958cb9c', 'f351e29a-8cd0-4403-8927-2441be87cd1c', '0f5f0492-6e26-47c4-bce8-720230cfda71'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:23 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:23 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:23 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Deleted volume successfully. Nov 03 18:33:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1c496dd-7c97-4867-8d8c-0a6b7ed21a94 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-9fdbf409-9285-435b-a8c8-57e1892aeae7-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:25 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (7580811a-2006-4e4a-ab96-641b32e7124d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aef5551-89dc-4c62-849c-bc31e3428670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aef5551-89dc-4c62-849c-bc31e3428670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2029239852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba551eda-4452-476c-8939-c65adcaabf70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:26Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ff8a2a-61ca-4cca-86a2-ec1ef250eec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ff8a2a-61ca-4cca-86a2-ec1ef250eec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f790329-ab36-412e-8d89-2bebaa593b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f790329-ab36-412e-8d89-2bebaa593b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba551eda-4452-476c-8939-c65adcaabf70', 'volume_name': 'volume-ba551eda-4452-476c-8939-c65adcaabf70', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a104ec29-5724-4633-9dcc-665b0a69b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a104ec29-5724-4633-9dcc-665b0a69b872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437a55ee-4e2d-420e-b8f6-318e9cb1b19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Volume ba551eda-4452-476c-8939-c65adcaabf70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba551eda-4452-476c-8939-c65adcaabf70', 'volume_size': 1} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2029239852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba551eda-4452-476c-8939-c65adcaabf70,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:26Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Creating volume ba551eda-4452-476c-8939-c65adcaabf70 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:26 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:26 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 1073741824 Nov 03 18:33:26 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-0f85d479-7ed1-44c7-81f1-945bb421f43d req-d4371abb-4c5d-4e92-894a-adbdc761adfe tempest-TestInstancesWithCinderVolumes-425655191 None] Terminate volume connection completed successfully. Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-0f85d479-7ed1-44c7-81f1-945bb421f43d req-d4371abb-4c5d-4e92-894a-adbdc761adfe tempest-TestInstancesWithCinderVolumes-425655191 None] Deleting attachment ef1721e0-ff9a-4693-b0f5-9d6917109ef7. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:33:26 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 1073741824" returned: 0 in 0.465s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:26 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 Nov 03 18:33:26 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:26 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437a55ee-4e2d-420e-b8f6-318e9cb1b19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba551eda-4452-476c-8939-c65adcaabf70', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549036af-9616-49dc-afe3-f423f4864469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Volume volume-ba551eda-4452-476c-8939-c65adcaabf70 (ba551eda-4452-476c-8939-c65adcaabf70): created successfully Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (549036af-9616-49dc-afe3-f423f4864469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (7580811a-2006-4e4a-ab96-641b32e7124d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4f4cfd56-ba0a-45a6-8937-7213c7c040a0 tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "cinder-61bb27ad-ac76-4c2f-9cb1-2b4a95238559-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-61bb27ad-ac76-4c2f-9cb1-2b4a95238559-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "cinder-quobyte-61bb27ad-ac76-4c2f-9cb1-2b4a95238559" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-quobyte-61bb27ad-ac76-4c2f-9cb1-2b4a95238559" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a081950-56d8-4010-83d2-c4def53dff3b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:27 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 Nov 03 18:33:27 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:27 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559" returned: 0 in 0.374s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:27 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559 Nov 03 18:33:27 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:27 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-61bb27ad-ac76-4c2f-9cb1-2b4a95238559" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-quobyte-61bb27ad-ac76-4c2f-9cb1-2b4a95238559" released by "delete_volume" :: held 0.697s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:28 devstack cinder-volume[86841]: WARNING cinder.quota [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214038940-1406888690 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214038940-1406888690, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:33:28 devstack cinder-volume[86841]: WARNING cinder.quota [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214038940-1406888690 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1214038940-1406888690, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Created reservations ['3cc8c175-2664-4d4d-896c-c6459e282030', '0ab08461-30b5-43e1-9e04-71f31a875f90', 'a3f527a8-6f63-4d2f-add1-bb281d088f44', '75549c9e-334a-4df3-bbb9-5ec3d249f010'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:28 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:28 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:28 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.331s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Deleted volume successfully. Nov 03 18:33:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6de38c5b-477e-4e60-8056-ec054ea0c8b8 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-61bb27ad-ac76-4c2f-9cb1-2b4a95238559-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (9be98ebc-46f5-47e5-97e2-9be23c3829cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac259df-ef17-4aad-9b3c-a96bebab07c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac259df-ef17-4aad-9b3c-a96bebab07c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-724866840',display_name='tempest-VolumesGetTest-Volume-973671511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e2143b-6406-42b0-b23a-c312dae8e75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:29Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca78afe-0c06-4d9b-9007-0b494eb3d907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca78afe-0c06-4d9b-9007-0b494eb3d907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac1e384-8c68-4d7f-abc9-c2a60298d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac1e384-8c68-4d7f-abc9-c2a60298d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3e2143b-6406-42b0-b23a-c312dae8e75c', 'volume_name': 'volume-d3e2143b-6406-42b0-b23a-c312dae8e75c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0b123c-b73f-4d3f-8ef2-aa4d8a31275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc0b123c-b73f-4d3f-8ef2-aa4d8a31275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e9b9a0-019e-41c7-a281-dd160ed30ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Volume d3e2143b-6406-42b0-b23a-c312dae8e75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3e2143b-6406-42b0-b23a-c312dae8e75c', 'volume_size': 1} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-724866840',display_name='tempest-VolumesGetTest-Volume-973671511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3e2143b-6406-42b0-b23a-c312dae8e75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:29Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Creating volume d3e2143b-6406-42b0-b23a-c312dae8e75c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:29 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:29 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c 1073741824 Nov 03 18:33:29 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:29 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c 1073741824" returned: 0 in 0.654s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:29 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c Nov 03 18:33:29 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:30 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e9b9a0-019e-41c7-a281-dd160ed30ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3e2143b-6406-42b0-b23a-c312dae8e75c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbdc39b-9d26-4370-82bb-f1bdc4b69ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Volume volume-d3e2143b-6406-42b0-b23a-c312dae8e75c (d3e2143b-6406-42b0-b23a-c312dae8e75c): created successfully Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbdc39b-9d26-4370-82bb-f1bdc4b69ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (9be98ebc-46f5-47e5-97e2-9be23c3829cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9b712fd6-3ebd-4820-8670-d5fb907dcf77 tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-a80c71a4-55f5-47f6-89b9-fce0dfbf6650 req-abf4e7c7-2f49-4bd3-bc16-bd5adf71a234 tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-a80c71a4-55f5-47f6-89b9-fce0dfbf6650 req-abf4e7c7-2f49-4bd3-bc16-bd5adf71a234 tempest-TestStampPattern-1835977746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-a80c71a4-55f5-47f6-89b9-fce0dfbf6650 req-abf4e7c7-2f49-4bd3-bc16-bd5adf71a234 tempest-TestStampPattern-1835977746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-a80c71a4-55f5-47f6-89b9-fce0dfbf6650 req-abf4e7c7-2f49-4bd3-bc16-bd5adf71a234 tempest-TestStampPattern-1835977746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-177c50da-d6fb-4c1a-92d8-0e931902ef09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '27db5707-22fa-48e6-9fe6-7d5d02fa6d51', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:33:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-a80c71a4-55f5-47f6-89b9-fce0dfbf6650 req-abf4e7c7-2f49-4bd3-bc16-bd5adf71a234 tempest-TestStampPattern-1835977746 None] attachment_update completed successfully. Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-d3e2143b-6406-42b0-b23a-c312dae8e75c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Lock "cinder-d3e2143b-6406-42b0-b23a-c312dae8e75c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-d3e2143b-6406-42b0-b23a-c312dae8e75c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-d3e2143b-6406-42b0-b23a-c312dae8e75c" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7468aabc-8fdf-4943-846d-04945cfa64f7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:31 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c Nov 03 18:33:31 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:32 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c" returned: 0 in 0.487s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:32 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c Nov 03 18:33:32 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-0c919fe1-ca0c-4c1a-96ab-3e7b92d86049 req-7d254fb7-24cf-43ee-9a4b-bbe811445e1d tempest-TestInstancesWithCinderVolumes-425655191 None] Terminate volume connection completed successfully. Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-0c919fe1-ca0c-4c1a-96ab-3e7b92d86049 req-7d254fb7-24cf-43ee-9a4b-bbe811445e1d tempest-TestInstancesWithCinderVolumes-425655191 None] Deleting attachment f244333c-64e5-4031-bd24-97bae91db5fa. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:33:32 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d3e2143b-6406-42b0-b23a-c312dae8e75c" returned: 0 in 0.372s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-d3e2143b-6406-42b0-b23a-c312dae8e75c" released by "delete_volume" :: held 0.919s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Created reservations ['4091ffd5-f008-4b31-a574-d6c859b2e285', '0b6d20ba-f895-42b6-b409-db63dee4bcda', 'a9796862-2f6b-42ec-866f-25f4f8563fc2', 'e1607b14-6ec8-456b-ba10-46f48cc29eee'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:32 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:32 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-ba551eda-4452-476c-8939-c65adcaabf70-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Lock "cinder-ba551eda-4452-476c-8939-c65adcaabf70-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-ba551eda-4452-476c-8939-c65adcaabf70" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-ba551eda-4452-476c-8939-c65adcaabf70" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b562f-7c54-46e1-b5cf-767f20f89085]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:33 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.353s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ef70f8e0-d0a2-4c32-a3ed-b85cfb377252 tempest-VolumesGetTest-1506660734 None] Lock "cinder-d3e2143b-6406-42b0-b23a-c312dae8e75c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:33 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 Nov 03 18:33:33 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:33 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "cinder-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70" returned: 0 in 0.405s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:33 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70 Nov 03 18:33:33 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "cinder-quobyte-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-quobyte-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a966a3d-4af3-40ee-b497-7c0648ec47c3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:33 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 Nov 03 18:33:33 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:33 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ba551eda-4452-476c-8939-c65adcaabf70" returned: 0 in 0.292s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-ba551eda-4452-476c-8939-c65adcaabf70" released by "delete_volume" :: held 0.774s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Created reservations ['1af8296a-c7f4-4ddd-b522-cb80fce833f8', '85a613e4-3b90-43cb-8ea9-d849bea0d636', '6069cfd1-bc3c-4e6b-8902-8be7ba6a1281', '93591eb6-b9a6-4da8-a7be-6800bc548d88'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:34 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:34 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:34 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" returned: 0 in 0.424s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:34 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073 Nov 03 18:33:34 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:34 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.508s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:33:34 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" returned: 0 in 0.438s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-quobyte-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073" released by "delete_volume" :: held 0.935s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1da4f366-befb-49c8-a98c-2c51f3fdd0f8 tempest-VolumesGetTest-1506660734 None] Lock "cinder-ba551eda-4452-476c-8939-c65adcaabf70-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:34 devstack cinder-volume[86841]: WARNING cinder.quota [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-231805424-1587460144 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-231805424-1587460144, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:33:34 devstack cinder-volume[86841]: WARNING cinder.quota [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-231805424-1587460144 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-231805424-1587460144, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Created reservations ['e6a25d76-efe8-4a79-849c-82d08b6d51f9', '8cdff009-0708-455d-864f-700b06564faa', 'b192753d-d8c0-475b-8022-a785a8d3ee28', '2aac72f8-ce15-4881-8f77-7b10884ee563'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-d4a507c2-a20b-45ba-b6c0-671df2b77abc req-507927ed-e5a4-4c80-9422-1b77a5376023 tempest-TestStampPattern-1835977746 None] Terminate volume connection completed successfully. Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-d4a507c2-a20b-45ba-b6c0-671df2b77abc req-507927ed-e5a4-4c80-9422-1b77a5376023 tempest-TestStampPattern-1835977746 None] Deleting attachment 27db5707-22fa-48e6-9fe6-7d5d02fa6d51. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:34 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:34 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (4d0c5057-6e61-4974-be2b-19ae890e9eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3dde39-50fe-4801-bb32-b32c96740bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3dde39-50fe-4801-bb32-b32c96740bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1510532097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948393de-85b1-4f5f-aca7-e36dd15aa7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:35Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f41dd9-452e-43fb-8f00-fec561dded97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f41dd9-452e-43fb-8f00-fec561dded97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea27a6e-c2de-479f-ba34-e4fa536e7637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea27a6e-c2de-479f-ba34-e4fa536e7637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'volume_name': 'volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd9efbc-c7b6-4387-bd5a-d0ad1b34c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd9efbc-c7b6-4387-bd5a-d0ad1b34c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bbd204-2bd3-4778-9f1d-b3744d589953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Volume 948393de-85b1-4f5f-aca7-e36dd15aa7c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'volume_size': 1} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1510532097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948393de-85b1-4f5f-aca7-e36dd15aa7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:35Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Creating volume 948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:35 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:35 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.439s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Deleted volume successfully. Nov 03 18:33:35 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 1073741824 Nov 03 18:33:35 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6eddd8ed-ee07-4e24-ae10-9d7602fdbb19 tempest-TestInstancesWithCinderVolumes-425655191 None] Lock "cinder-5c1db37b-b11d-4224-a3e9-3d9b8e0ab073-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Flow 'volume_create_manager' (8feca604-087b-4ee1-b548-82641a5580ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76bfee5-8433-4d72-8580-ea3f1b938616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76bfee5-8433-4d72-8580-ea3f1b938616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1212933061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a854bd1-26e8-4002-9785-a27401a77616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5639e891332048349c73a62acf754c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:35Z,use_quota=True,user_id='124955aee72f4b5aaf34b5f51a01d2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772b6592-5ee3-42a4-b374-5548fc24d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772b6592-5ee3-42a4-b374-5548fc24d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c68320a-c08a-4475-86eb-cc81960f0f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c68320a-c08a-4475-86eb-cc81960f0f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a854bd1-26e8-4002-9785-a27401a77616', 'volume_name': 'volume-7a854bd1-26e8-4002-9785-a27401a77616', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73527456-c037-4de3-b0f3-703721d87813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73527456-c037-4de3-b0f3-703721d87813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b41e10-d1e1-4b2d-84c8-8d07c1cac981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:35 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Volume 7a854bd1-26e8-4002-9785-a27401a77616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a854bd1-26e8-4002-9785-a27401a77616', 'volume_size': 1} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:35 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 1073741824" returned: 0 in 0.568s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:35 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 Nov 03 18:33:35 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:36 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5" returned: 0 in 0.331s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1212933061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a854bd1-26e8-4002-9785-a27401a77616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5639e891332048349c73a62acf754c4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:35Z,use_quota=True,user_id='124955aee72f4b5aaf34b5f51a01d2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Creating volume 7a854bd1-26e8-4002-9785-a27401a77616 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:36 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:36 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 1073741824 Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bbd204-2bd3-4778-9f1d-b3744d589953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:36 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49577538-24d8-4ff4-9164-00764bad3edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:DELETE=11,cinder:UPDATE=119,cinder:SELECT=104,cinder:INSERT=23 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:33:36 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Volume volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 (948393de-85b1-4f5f-aca7-e36dd15aa7c5): created successfully Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49577538-24d8-4ff4-9164-00764bad3edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (4d0c5057-6e61-4974-be2b-19ae890e9eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:36 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6926a6e4-fc5f-41c7-a372-e62e84f32e2c tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:33:37 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 1073741824" returned: 0 in 0.870s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=99,cinder:SELECT=103,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:37 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 Nov 03 18:33:37 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:37 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616" returned: 0 in 0.394s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b41e10-d1e1-4b2d-84c8-8d07c1cac981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a854bd1-26e8-4002-9785-a27401a77616', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea2ed60-2364-40cd-857a-e5f9c40b624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:37 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Volume volume-7a854bd1-26e8-4002-9785-a27401a77616 (7a854bd1-26e8-4002-9785-a27401a77616): created successfully Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea2ed60-2364-40cd-857a-e5f9c40b624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Flow 'volume_create_manager' (8feca604-087b-4ee1-b548-82641a5580ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-02a8784e-6f2f-476c-b466-3aa11d050241 tempest-AttachVolumeNegativeTest-1551287458 None] Created volume successfully. Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (c76350ee-71f3-4967-9445-72d5386875fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e431b28-ecf1-4fa0-8933-de3c7b183c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e431b28-ecf1-4fa0-8933-de3c7b183c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-948118139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=948393de-85b1-4f5f-aca7-e36dd15aa7c5,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:38Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c796e7f-0301-4a80-9da2-fd9de6845479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c796e7f-0301-4a80-9da2-fd9de6845479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77732f27-6ab1-4e43-b9a4-4d891206c125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77732f27-6ab1-4e43-b9a4-4d891206c125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d', 'volume_name': 'volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d', 'volume_size': 1, 'source_volid': '948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'source_volstatus': 'available'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b927d8b-0764-4817-ade4-d71c23f6b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b927d8b-0764-4817-ade4-d71c23f6b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066c8594-35d5-4017-a152-a966158225f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:37 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Volume f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d', 'volume_size': 1, 'source_volid': '948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'source_volstatus': 'available'} Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:38 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Cloning volume 948393de-85b1-4f5f-aca7-e36dd15aa7c5 to volume f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Creating offline snapshot b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 of volume 948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3604f1-0198-48a2-a7d6-600495a162a3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:38 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 Nov 03 18:33:38 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:38 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5" returned: 0 in 0.615s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:38 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 1G Nov 03 18:33:38 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:39 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 1G" returned: 0 in 0.585s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:39 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 Nov 03 18:33:39 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-aa96a654-37aa-4773-9688-3a7e7b06eeb8 req-994d5df4-b5f4-4404-8b93-e8dd77e81e37 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:39 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" returned: 0 in 0.388s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:39 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 is being set with open permissions: ugo+rw Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:39 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 Nov 03 18:33:39 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-177c50da-d6fb-4c1a-92d8-0e931902ef09-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Lock "cinder-177c50da-d6fb-4c1a-92d8-0e931902ef09-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-quobyte-177c50da-d6fb-4c1a-92d8-0e931902ef09" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-177c50da-d6fb-4c1a-92d8-0e931902ef09" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843eddb-dc4d-44e8-863b-fe8b63540ff0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:39 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 Nov 03 18:33:39 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:39 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" returned: 0 in 0.275s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:40 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info Nov 03 18:33:40 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:40 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:40 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09 Nov 03 18:33:40 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:40 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info" returned: 0 in 0.289s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:40 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info is being set with open permissions: ugo+rw Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:40 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info Nov 03 18:33:40 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:40 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-177c50da-d6fb-4c1a-92d8-0e931902ef09" returned: 0 in 0.343s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-177c50da-d6fb-4c1a-92d8-0e931902ef09" released by "delete_volume" :: held 0.798s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:40 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.info" returned: 0 in 0.341s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] snapshot: b0f8e6ce-0c0d-470c-8dc9-fa28552449f6, volume: f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[57efec9e-db81-4729-9387-1ee6209d866a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Created reservations ['6055dec6-1398-444f-9864-830acf246ba3', '7c6bb596-374a-48c8-bdbb-ec1ff5c917d8', '9cfbe2e1-df0f-4288-9e44-671a3a22da6f', '24f1b75a-4a23-4553-a069-1cb3b058e1ea'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:40 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 Nov 03 18:33:40 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:40 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:40 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:41 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" returned: 0 in 0.468s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:33:41 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.365s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd60a8-0fe9-43ed-984c-f830fc765b14]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Deleted volume successfully. Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0dc3e928-951b-4455-8f20-c63d234a01eb tempest-TestStampPattern-1835977746 None] Lock "cinder-177c50da-d6fb-4c1a-92d8-0e931902ef09-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-297dc5b1-a6de-475f-afc9-da1ac389678b-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Lock "cinder-297dc5b1-a6de-475f-afc9-da1ac389678b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-quobyte-f2b1af56-7b34-4182-8b80-a43fd8845e66" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-f2b1af56-7b34-4182-8b80-a43fd8845e66" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-quobyte-297dc5b1-a6de-475f-afc9-da1ac389678b" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:41 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 Nov 03 18:33:41 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-297dc5b1-a6de-475f-afc9-da1ac389678b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Deleting offline snapshot 297dc5b1-a6de-475f-afc9-da1ac389678b of volume f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] snapshot_file for this snap is: volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b639f5-8228-4d6d-bf72-1fe3d7a476bf]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:41 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b Nov 03 18:33:41 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:41 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5" returned: 0 in 0.489s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:41 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d Nov 03 18:33:41 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:41 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b" returned: 0 in 0.476s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2b1af56-7b34-4182-8b80-a43fd8845e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[76826043-1638-4c2c-9d2b-9b53da14c294]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:42 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 Nov 03 18:33:42 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:43 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66" returned: 0 in 1.133s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:43 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b Nov 03 18:33:43 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:43 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b" returned: 0 in 0.653s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:43 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b Nov 03 18:33:43 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:44 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66.297dc5b1-a6de-475f-afc9-da1ac389678b" returned: 0 in 0.432s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-297dc5b1-a6de-475f-afc9-da1ac389678b" released by "_delete_snapshot" :: held 2.920s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-f2b1af56-7b34-4182-8b80-a43fd8845e66" released by "delete_snapshot" :: held 2.980s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:44 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Created reservations ['5690fd63-6ba0-4fea-8368-6ed1eb4a19e9', '4a6e99c3-d750-4966-b3e0-9fea180f1b0b', '4a535b8b-beed-45ae-a543-23f13ba4f7c2', 'ae4c1666-25c7-4784-97e5-122948437114'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Delete snapshot completed successfully. Nov 03 18:33:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b66202b9-b073-48a4-9479-39d9ef3296c3 tempest-TestStampPattern-1835977746 None] Lock "cinder-297dc5b1-a6de-475f-afc9-da1ac389678b-delete_snapshot" released by "delete_snapshot" :: held 3.282s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-f2b1af56-7b34-4182-8b80-a43fd8845e66-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Lock "cinder-f2b1af56-7b34-4182-8b80-a43fd8845e66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Acquiring lock "cinder-quobyte-f2b1af56-7b34-4182-8b80-a43fd8845e66" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-f2b1af56-7b34-4182-8b80-a43fd8845e66" acquired by "delete_volume" :: waited 0.053s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[515dae69-d63b-48d4-a742-4de97680db1a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:50 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" returned: 0 in 8.836s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:33:50 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Converted 1024.00 MB image at 115.86 MB/s Nov 03 18:33:50 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d is being set with open permissions: ugo+rw Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:50 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d Nov 03 18:33:50 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:50 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 Nov 03 18:33:50 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:50 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" released by "_copy_volume_from_snapshot" :: held 10.187s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Deleting offline snapshot b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 of volume 948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] snapshot_file for this snap is: volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7699ff-d045-4ce5-bdd9-b056af8f92be]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:50 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:51 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66 Nov 03 18:33:51 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:51 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 Nov 03 18:33:51 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:51 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f2b1af56-7b34-4182-8b80-a43fd8845e66" returned: 0 in 0.272s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Lock "cinder-quobyte-f2b1af56-7b34-4182-8b80-a43fd8845e66" released by "delete_volume" :: held 0.854s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Created reservations ['7af1c8a9-6e0c-4d66-ad1a-694abfa3227e', 'c1a4ecc7-7ff9-4e84-9db9-48b5377ed1d0', '408b7bbf-3578-46bf-ac07-1b81440f62b7', 'dfd8c084-0bbc-4e1c-a5ff-9e8de0b3a644'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:51 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" returned: 0 in 0.417s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a1277-42c2-46ec-9404-8d2a10f9312c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:51 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:51 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:51 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 Nov 03 18:33:51 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:51 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.282s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Deleted volume successfully. Nov 03 18:33:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6f547c5a-c3b0-4654-a97f-279441dd56b4 tempest-TestStampPattern-1835977746 None] Lock "cinder-f2b1af56-7b34-4182-8b80-a43fd8845e66-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:52 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5" returned: 0 in 0.624s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:52 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 Nov 03 18:33:52 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:52 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" returned: 0 in 0.340s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:52 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6 Nov 03 18:33:52 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:52 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5.b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-b0f8e6ce-0c0d-470c-8dc9-fa28552449f6" released by "_delete_snapshot" :: held 1.782s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.719s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-aa96a654-37aa-4773-9688-3a7e7b06eeb8 req-994d5df4-b5f4-4404-8b93-e8dd77e81e37 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.251s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-aa96a654-37aa-4773-9688-3a7e7b06eeb8 req-994d5df4-b5f4-4404-8b93-e8dd77e81e37 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066c8594-35d5-4017-a152-a966158225f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d', 'volume_size': 1, 'source_volid': '948393de-85b1-4f5f-aca7-e36dd15aa7c5', 'source_volstatus': 'available'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd612be-3f2d-4258-98c3-944755affd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Volume volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d (f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d): created successfully Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd612be-3f2d-4258-98c3-944755affd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (c76350ee-71f3-4967-9445-72d5386875fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-aa96a654-37aa-4773-9688-3a7e7b06eeb8 req-994d5df4-b5f4-4404-8b93-e8dd77e81e37 tempest-AttachVolumeNegativeTest-1551287458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-7a854bd1-26e8-4002-9785-a27401a77616', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09bb9e2e-e08f-423f-a219-96589835b911', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:33:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c9bbd75f-6e9b-4873-a8f2-82f39e769720 tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:33:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-aa96a654-37aa-4773-9688-3a7e7b06eeb8 req-994d5df4-b5f4-4404-8b93-e8dd77e81e37 tempest-AttachVolumeNegativeTest-1551287458 None] attachment_update completed successfully. Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (5ef4a68d-e7ef-4878-9e91-7147309246f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b3487c-66eb-40ce-996a-7c5a7502c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b3487c-66eb-40ce-996a-7c5a7502c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-41809233',display_name='tempest-VolumesGetTest-Volume-634433489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dad986-2ac6-4e5b-9dab-95f559a620f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:54Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c900007-bfbb-4efe-9255-bb596ecbbcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c900007-bfbb-4efe-9255-bb596ecbbcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f944cf75-466d-4d78-9752-07315dfd4f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f944cf75-466d-4d78-9752-07315dfd4f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88dad986-2ac6-4e5b-9dab-95f559a620f9', 'volume_name': 'volume-88dad986-2ac6-4e5b-9dab-95f559a620f9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c0bf88-68d6-4cad-a2dc-746a5c771ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c0bf88-68d6-4cad-a2dc-746a5c771ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58c5a67-e029-4783-a5e3-7acb7b2d9f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Volume 88dad986-2ac6-4e5b-9dab-95f559a620f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88dad986-2ac6-4e5b-9dab-95f559a620f9', 'volume_size': 1} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-41809233',display_name='tempest-VolumesGetTest-Volume-634433489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dad986-2ac6-4e5b-9dab-95f559a620f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:54Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Creating volume 88dad986-2ac6-4e5b-9dab-95f559a620f9 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:54 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:54 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 1073741824 Nov 03 18:33:54 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:54 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 1073741824" returned: 0 in 0.544s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:54 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 Nov 03 18:33:54 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:55 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9" returned: 0 in 0.310s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58c5a67-e029-4783-a5e3-7acb7b2d9f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88dad986-2ac6-4e5b-9dab-95f559a620f9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b783e4-5aa1-46b5-a0a0-d715f1c78611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Volume volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 (88dad986-2ac6-4e5b-9dab-95f559a620f9): created successfully Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b783e4-5aa1-46b5-a0a0-d715f1c78611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (5ef4a68d-e7ef-4878-9e91-7147309246f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-386ebb27-f512-44b1-9845-7c8575041ec2 tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (7d349c21-2122-4fa5-97cf-f938ae6d2869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0b4e2d-ef46-475a-a9c4-e622ea8d001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0b4e2d-ef46-475a-a9c4-e622ea8d001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105909207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a8e8e9-1535-4151-9fcb-43d426fbcac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:55Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4184ba52-b1a5-48fa-aab1-96ee49ce928f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4184ba52-b1a5-48fa-aab1-96ee49ce928f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9f1189-235d-4ebd-88a8-5560d8118e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9f1189-235d-4ebd-88a8-5560d8118e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a8e8e9-1535-4151-9fcb-43d426fbcac2', 'volume_name': 'volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae082da-47d8-4e64-8248-436cd389000c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae082da-47d8-4e64-8248-436cd389000c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6cdf02-9bb3-4cf2-a198-ce558cbe1f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Volume f6a8e8e9-1535-4151-9fcb-43d426fbcac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2', 'volume_size': 1} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2105909207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a8e8e9-1535-4151-9fcb-43d426fbcac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:33:55Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Creating volume f6a8e8e9-1535-4151-9fcb-43d426fbcac2 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:33:55 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:55 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 1073741824 Nov 03 18:33:55 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-af03d2e9-eeed-4ae1-9054-11a5f724c605 req-97eba76a-8f1b-4c7a-84a6-a5a75fef299a tempest-AttachVolumeNegativeTest-1551287458 None] Terminate volume connection completed successfully. Nov 03 18:33:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-af03d2e9-eeed-4ae1-9054-11a5f724c605 req-97eba76a-8f1b-4c7a-84a6-a5a75fef299a tempest-AttachVolumeNegativeTest-1551287458 None] Deleting attachment 09bb9e2e-e08f-423f-a219-96589835b911. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:33:56 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 1073741824" returned: 0 in 0.574s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:56 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 Nov 03 18:33:56 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:56 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2" returned: 0 in 0.274s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-88dad986-2ac6-4e5b-9dab-95f559a620f9-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6cdf02-9bb3-4cf2-a198-ce558cbe1f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ac5cf2-0759-458a-b414-c302f221eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Lock "cinder-88dad986-2ac6-4e5b-9dab-95f559a620f9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Volume volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 (f6a8e8e9-1535-4151-9fcb-43d426fbcac2): created successfully Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ac5cf2-0759-458a-b414-c302f221eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (7d349c21-2122-4fa5-97cf-f938ae6d2869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:33:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f14ca0e1-c99a-4aec-a334-4b327ece5cf4 tempest-ProjectReaderTests-283321100 None] Created volume successfully. Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-88dad986-2ac6-4e5b-9dab-95f559a620f9" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-88dad986-2ac6-4e5b-9dab-95f559a620f9" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bebf1e-83b2-4568-a9d3-c0c7f80df048]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:56 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 Nov 03 18:33:56 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:57 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:57 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9 Nov 03 18:33:57 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:57 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-88dad986-2ac6-4e5b-9dab-95f559a620f9" returned: 0 in 0.520s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-88dad986-2ac6-4e5b-9dab-95f559a620f9" released by "delete_volume" :: held 1.035s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Created reservations ['d7cd15d0-2421-4ea9-9eab-76401ab424a2', '561f99c1-5d21-41f7-a6e3-b8a43fd054ac', '1bd9cfd1-8a80-4a28-a24f-b3491a0b7110', '905f3734-8ebe-41ba-8f38-605db2662b93'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:57 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:57 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-f6a8e8e9-1535-4151-9fcb-43d426fbcac2-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Lock "cinder-f6a8e8e9-1535-4151-9fcb-43d426fbcac2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-quobyte-f6a8e8e9-1535-4151-9fcb-43d426fbcac2" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-f6a8e8e9-1535-4151-9fcb-43d426fbcac2" acquired by "delete_volume" :: waited 0.042s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de412d-4983-4428-b466-692b6c2600ae]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:58 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-25a37c3a-a36d-435e-985c-c4525ceb75d1 tempest-VolumesGetTest-1506660734 None] Lock "cinder-88dad986-2ac6-4e5b-9dab-95f559a620f9-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:58 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 Nov 03 18:33:58 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:58 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2" returned: 0 in 0.531s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:58 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2 Nov 03 18:33:58 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Lock "cinder-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccbde09-97b4-4291-8664-f7af90f1bda1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:59 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f6a8e8e9-1535-4151-9fcb-43d426fbcac2" returned: 0 in 0.406s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-f6a8e8e9-1535-4151-9fcb-43d426fbcac2" released by "delete_volume" :: held 1.007s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Created reservations ['369d5741-49c5-4d91-8849-337e97a76812', 'e56e5a98-811d-4ee6-8e45-1225846cf604', '40b1f40e-82ca-49b5-9b0b-f18d2d59863d', '4a0d03a6-e918-4ae6-838e-1611f507651d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:33:59 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d Nov 03 18:33:59 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:59 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:59 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:59 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:33:59 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:59 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" returned: 0 in 0.642s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:33:59 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.480s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:59 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d Nov 03 18:33:59 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:33:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Deleted volume successfully. Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6e42b601-934a-4195-9fd4-e04d7efef82b tempest-ProjectReaderTests-283321100 None] Lock "cinder-f6a8e8e9-1535-4151-9fcb-43d426fbcac2-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:33:59 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.429s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:33:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:34:00 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d" released by "delete_volume" :: held 1.003s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Created reservations ['05bc3d3d-f0d7-41e8-9ae5-deb46f6b53d4', '1aa4d271-0a61-4931-b22a-1870936fc919', '64aa9879-8957-4597-81d4-3af8170fb754', '3265bf51-953d-4bf2-8f69-f95302a3ea56'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:00 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:00 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:00 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.268s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09b337e0-8527-49e8-b4aa-84aa4c98665e tempest-VolumesGetTest-1506660734 None] Lock "cinder-f0c6902c-4ee0-4f01-b6df-ed2c37bd1b6d-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (a75d8f9e-156f-4ce7-9a01-28deb89d5112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e6e344-9a82-4c71-9deb-bfb5ead5f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e6e344-9a82-4c71-9deb-bfb5ead5f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300582093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051476a6-8c8c-4ad2-b385-f3442fa4e6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:01Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed777a65-1bc3-4f69-b9e2-bc4cfd228258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed777a65-1bc3-4f69-b9e2-bc4cfd228258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69426b32-e341-4ddb-b4af-4002389b5b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69426b32-e341-4ddb-b4af-4002389b5b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051476a6-8c8c-4ad2-b385-f3442fa4e6c8', 'volume_name': 'volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b556eb-e85c-4ce8-a38b-1d135b10d685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b556eb-e85c-4ce8-a38b-1d135b10d685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2f589c-87af-4b5a-812f-73e74d21dc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Volume 051476a6-8c8c-4ad2-b385-f3442fa4e6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8', 'volume_size': 1} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300582093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051476a6-8c8c-4ad2-b385-f3442fa4e6c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:01Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Creating volume 051476a6-8c8c-4ad2-b385-f3442fa4e6c8 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:00 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:00 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 1073741824 Nov 03 18:34:00 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-948393de-85b1-4f5f-aca7-e36dd15aa7c5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Lock "cinder-948393de-85b1-4f5f-aca7-e36dd15aa7c5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-948393de-85b1-4f5f-aca7-e36dd15aa7c5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-948393de-85b1-4f5f-aca7-e36dd15aa7c5" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5707dac-918b-43a1-aea8-e0b8487a9ce9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:01 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 1073741824" returned: 0 in 0.613s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:01 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 Nov 03 18:34:01 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:01 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 Nov 03 18:34:01 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "cinder-7a854bd1-26e8-4002-9785-a27401a77616-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-7a854bd1-26e8-4002-9785-a27401a77616-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "cinder-quobyte-7a854bd1-26e8-4002-9785-a27401a77616" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-quobyte-7a854bd1-26e8-4002-9785-a27401a77616" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:01 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8" returned: 0 in 0.446s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:02 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2f589c-87af-4b5a-812f-73e74d21dc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c9a23d-f2a8-431a-8e26-585168cfe64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4313bb0b-2d5a-4003-ac6f-fed73320331b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5" returned: 0 in 0.562s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:02 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Volume volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 (051476a6-8c8c-4ad2-b385-f3442fa4e6c8): created successfully Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c9a23d-f2a8-431a-8e26-585168cfe64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (a75d8f9e-156f-4ce7-9a01-28deb89d5112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-31af7215-52e2-4883-8f9a-b758f52bffee tempest-ProjectReaderTests-283321100 None] Created volume successfully. Nov 03 18:34:02 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5 Nov 03 18:34:02 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:02 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 Nov 03 18:34:02 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:02 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-948393de-85b1-4f5f-aca7-e36dd15aa7c5" returned: 0 in 0.278s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-948393de-85b1-4f5f-aca7-e36dd15aa7c5" released by "delete_volume" :: held 0.917s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:02 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Created reservations ['8dd16740-a765-484b-9bf5-09e13b399eea', '10e45caa-4bb9-424f-bf8b-ae8b86d94d18', '845f3ec5-7bef-40a7-957a-7053117e800d', 'ff38a80d-b0e8-4a56-9b66-f85214df2dae'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616" returned: 0 in 0.414s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:02 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616 Nov 03 18:34:02 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:02 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:02 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:02 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-7a854bd1-26e8-4002-9785-a27401a77616" returned: 0 in 0.289s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-quobyte-7a854bd1-26e8-4002-9785-a27401a77616" released by "delete_volume" :: held 0.762s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Created reservations ['c9eecbcc-8532-40bb-b036-ca6f0fd7d118', '66be19e8-d06c-445a-b5dd-610d91190436', '072bd82d-ff65-4e23-91bb-91444e8b785f', '39ff2dbf-5f71-45ab-a35b-0a9215a2ec1d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:02 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e38b3a4d-66f6-4cdf-ab3c-937bffce3f03 tempest-VolumesGetTest-1506660734 None] Lock "cinder-948393de-85b1-4f5f-aca7-e36dd15aa7c5-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:03 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:03 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-051476a6-8c8c-4ad2-b385-f3442fa4e6c8-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Lock "cinder-051476a6-8c8c-4ad2-b385-f3442fa4e6c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-quobyte-051476a6-8c8c-4ad2-b385-f3442fa4e6c8" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-051476a6-8c8c-4ad2-b385-f3442fa4e6c8" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "cinder-60932dd8-dd93-4679-86cd-8e3695c79b08-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-60932dd8-dd93-4679-86cd-8e3695c79b08-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65ecdf1-a6ad-4dd5-a603-ba6f599dfc42]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:03 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.410s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Deleted volume successfully. Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "cinder-quobyte-60932dd8-dd93-4679-86cd-8e3695c79b08" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-quobyte-60932dd8-dd93-4679-86cd-8e3695c79b08" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a60df914-53e5-4a5a-8a1c-12225b82cb6e tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-7a854bd1-26e8-4002-9785-a27401a77616-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f842496e-08f9-4107-bc1f-557cdb2daa29]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:03 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 Nov 03 18:34:03 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:03 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 Nov 03 18:34:03 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:03 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8" returned: 0 in 0.553s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:03 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:03 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8 Nov 03 18:34:03 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:03 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08 Nov 03 18:34:03 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:04 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-051476a6-8c8c-4ad2-b385-f3442fa4e6c8" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-051476a6-8c8c-4ad2-b385-f3442fa4e6c8" released by "delete_volume" :: held 0.992s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:04 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-60932dd8-dd93-4679-86cd-8e3695c79b08" returned: 0 in 0.342s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-quobyte-60932dd8-dd93-4679-86cd-8e3695c79b08" released by "delete_volume" :: held 0.866s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Created reservations ['08b76d27-f272-4228-98f7-93f63a56bb66', 'e46db254-bc8a-4fcb-8d2e-1c924a40c84d', 'be8fafa9-354e-48b3-ad3f-e69a32a7c552', 'c3a76ff4-1c8d-4cc5-af8b-d3d12cdb2160'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Created reservations ['ab274b5f-0b65-4f28-be6d-766f0cd30aa0', 'df2380f0-dcaf-4961-94f7-0e5f20352e90', 'e1362a6a-74cc-4d59-bb4d-8372af994848', '0210aea8-ce5c-40e4-bccc-8a25a70921fa'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:04 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:04 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:04 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:04 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (0d197768-b346-4ea0-8b70-b6cd017a339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13f47e9-48b9-4fbd-a8c5-f6f6ff5b6599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13f47e9-48b9-4fbd-a8c5-f6f6ff5b6599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1775095708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:05Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b8eb13-af2f-4ac8-8b42-50ccb0f47f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b8eb13-af2f-4ac8-8b42-50ccb0f47f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b0c952-52a5-4fae-abc4-db966ae35bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:34:04 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.296s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Deleted volume successfully. Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-34221a49-7c93-4c04-ae8f-379ef52f7baa tempest-ProjectReaderTests-283321100 None] Lock "cinder-051476a6-8c8c-4ad2-b385-f3442fa4e6c8-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:04 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.307s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Deleted volume successfully. Nov 03 18:34:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ae339cbb-1940-4765-90cc-9b1d3e5eee66 tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-60932dd8-dd93-4679-86cd-8e3695c79b08-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b0c952-52a5-4fae-abc4-db966ae35bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c', 'volume_name': 'volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fde790d-0979-4dd3-b801-84b2c068ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fde790d-0979-4dd3-b801-84b2c068ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4cd362-b46a-455a-a247-1f2a2d9919f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Volume e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Trying to clone e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:34:05 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Image download 20.69 MB at 20.69 MB/s Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc4b6f-da28-4394-996a-3415feb0c107]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:05 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD Nov 03 18:34:05 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "cinder-f66cad7d-af3e-4c77-9b30-9f71884dbe6d-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-f66cad7d-af3e-4c77-9b30-9f71884dbe6d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "cinder-quobyte-f66cad7d-af3e-4c77-9b30-9f71884dbe6d" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-quobyte-f66cad7d-af3e-4c77-9b30-9f71884dbe6d" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3c129d-11cf-4a74-99f7-8ae77f29b9c2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:06 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb is fetched for user 8126d5b052814304b2dc8f9ff56d429c. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (26addf3b-0e96-4db8-9e73-095bb22a4f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e33d053-6df5-4d62-a53c-c8139ee2699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e33d053-6df5-4d62-a53c-c8139ee2699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41166126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaafcb6b-e32c-4038-aa78-4a4b13e574a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:06Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2039f1d0-ebc4-4d21-80ea-a5396941c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2039f1d0-ebc4-4d21-80ea-a5396941c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:06 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d Nov 03 18:34:06 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34850480-46b3-4f73-9bab-83d8b09c6635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34850480-46b3-4f73-9bab-83d8b09c6635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaafcb6b-e32c-4038-aa78-4a4b13e574a3', 'volume_name': 'volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c4a658-18d1-47f1-a640-54127b3b3132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c4a658-18d1-47f1-a640-54127b3b3132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbee1dc1-f952-42ab-aa10-84c61de4719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:06 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Volume eaafcb6b-e32c-4038-aa78-4a4b13e574a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3', 'volume_size': 1} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41166126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaafcb6b-e32c-4038-aa78-4a4b13e574a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:06Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Creating volume eaafcb6b-e32c-4038-aa78-4a4b13e574a3 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:06 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:06 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 1073741824 Nov 03 18:34:06 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b49dcc3-1f12-44ed-82f6-7f6b0596c1d9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:06 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD Nov 03 18:34:06 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:06 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d" returned: 0 in 0.451s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:06 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d Nov 03 18:34:06 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:06 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:06 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f66cad7d-af3e-4c77-9b30-9f71884dbe6d" returned: 0 in 0.280s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:06 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-quobyte-f66cad7d-af3e-4c77-9b30-9f71884dbe6d" released by "delete_volume" :: held 0.802s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 1073741824" returned: 0 in 0.586s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:06 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Created reservations ['79c65f37-87e9-4e08-bd3a-bbbeb2080ebc', '844e7826-5ea5-4b5b-bcd0-b4d13b1c1a4b', '9f46cb05-002f-4e53-8059-d9fd45f05d5c', 'f85c2bea-7fbb-4acd-8506-204bf4cccf98'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:06 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 Nov 03 18:34:06 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:07 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:07 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:07 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3" returned: 0 in 0.304s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1775095708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:05Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Creating volume e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:07 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:07 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c 1073741824 Nov 03 18:34:07 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbee1dc1-f952-42ab-aa10-84c61de4719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d96471-7604-4bca-bac5-7a79fc1d9ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:07 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Volume volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 (eaafcb6b-e32c-4038-aa78-4a4b13e574a3): created successfully Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d96471-7604-4bca-bac5-7a79fc1d9ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (26addf3b-0e96-4db8-9e73-095bb22a4f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:07 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Deleted volume successfully. Nov 03 18:34:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-09179923-0417-4131-99a6-c0c3380d5b64 tempest-ProjectReaderTests-283321100 None] Created volume successfully. Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d096df99-3c0e-4262-bb0f-7f8cdd85337a tempest-AttachVolumeNegativeTest-1551287458 None] Lock "cinder-f66cad7d-af3e-4c77-9b30-9f71884dbe6d-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:07 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c 1073741824" returned: 0 in 0.568s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:07 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c Nov 03 18:34:07 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:08 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Attempting download of 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c77f6-6edb-4189-9f01-08f00ba1904e]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:08 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z Nov 03 18:34:08 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-eaafcb6b-e32c-4038-aa78-4a4b13e574a3-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Lock "cinder-eaafcb6b-e32c-4038-aa78-4a4b13e574a3-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-quobyte-eaafcb6b-e32c-4038-aa78-4a4b13e574a3" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-eaafcb6b-e32c-4038-aa78-4a4b13e574a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0089236b-b149-481f-bb80-4f4124533127]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:08 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z" returned: 0 in 0.510s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:08 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 Nov 03 18:34:08 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:09 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z Nov 03 18:34:09 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:09 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3" returned: 0 in 0.500s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:09 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3 Nov 03 18:34:09 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:09 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z" returned: 1 in 0.513s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_a746_n8z' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece7e2e6-4739-484b-9b09-48e6282d41f1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:09 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD Nov 03 18:34:09 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:09 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eaafcb6b-e32c-4038-aa78-4a4b13e574a3" returned: 0 in 0.319s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-eaafcb6b-e32c-4038-aa78-4a4b13e574a3" released by "delete_volume" :: held 0.886s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Created reservations ['f52f847b-105f-48b6-8692-be43b4615be5', 'd626741c-788a-4588-a3ee-cd233dc711b7', 'e3fccfe9-feb1-463e-8c3f-791ddb728317', '5db37302-a693-430b-9dbb-6c604490e033'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:09 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:09 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:09 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] 3cc5f1a8-28a8-4446-80b6-6636c7f415bb was qcow2, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:34:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:09 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c Nov 03 18:34:09 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:10 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.484s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Deleted volume successfully. Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1a104125-18eb-4652-8102-3fca38af60b0 tempest-ProjectReaderTests-283321100 None] Lock "cinder-eaafcb6b-e32c-4038-aa78-4a4b13e574a3-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (e159cf09-5791-4c65-a41a-c4d8ac814ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a27bb8-64bb-4f42-81eb-4b39506b57fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a27bb8-64bb-4f42-81eb-4b39506b57fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-589902157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5b0b1f-cc9e-4236-86bf-5f313e60f231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:10Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95910515-5677-47fa-9fb1-5cc4091d49ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95910515-5677-47fa-9fb1-5cc4091d49ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad49934-047a-4fcd-a02e-15ac6de56a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad49934-047a-4fcd-a02e-15ac6de56a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5b0b1f-cc9e-4236-86bf-5f313e60f231', 'volume_name': 'volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b0a4ea-73ce-4105-92de-f3bf83092829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b0a4ea-73ce-4105-92de-f3bf83092829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c575160-8430-4936-97e2-6c47d1539dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Volume 5f5b0b1f-cc9e-4236-86bf-5f313e60f231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231', 'volume_size': 1} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-589902157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5b0b1f-cc9e-4236-86bf-5f313e60f231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8847a1e4605c49a99c8a91bb6bc8911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:10Z,use_quota=True,user_id='6fbd6a82361e46c48de45e727e84c8c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Creating volume 5f5b0b1f-cc9e-4236-86bf-5f313e60f231 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:10 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:10 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 1073741824 Nov 03 18:34:10 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:11 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 1073741824" returned: 0 in 0.591s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:11 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 Nov 03 18:34:11 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:11 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231" returned: 0 in 0.331s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c575160-8430-4936-97e2-6c47d1539dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b5e68d-a80c-4ef4-aeb1-66e504a07a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Volume volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 (5f5b0b1f-cc9e-4236-86bf-5f313e60f231): created successfully Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22b5e68d-a80c-4ef4-aeb1-66e504a07a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Flow 'volume_create_manager' (e159cf09-5791-4c65-a41a-c4d8ac814ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3a9247f9-415a-49fd-9cc5-2c4618d65c95 tempest-ProjectReaderTests-283321100 None] Created volume successfully. Nov 03 18:34:12 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" returned: 0 in 2.583s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_uv2rr_p0devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:34:12 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Converted 112.00 MB image at 43.33 MB/s Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:12 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c 1G Nov 03 18:34:12 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-5f5b0b1f-cc9e-4236-86bf-5f313e60f231-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Lock "cinder-5f5b0b1f-cc9e-4236-86bf-5f313e60f231-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Acquiring lock "cinder-quobyte-5f5b0b1f-cc9e-4236-86bf-5f313e60f231" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-5f5b0b1f-cc9e-4236-86bf-5f313e60f231" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ac7c5-43a4-431b-9f6b-45b4d21ad427]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:12 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 Nov 03 18:34:12 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:12 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c 1G" returned: 0 in 0.426s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Downloaded image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb for user 8126d5b052814304b2dc8f9ff56d429c is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Marking volume e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Copying metadata from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb to e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Creating volume glance metadata for volume e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c backed by image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4cd362-b46a-455a-a247-1f2a2d9919f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac3ed8b-7d46-413f-8997-6ac4285fa114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Volume volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c (e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c): created successfully Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac3ed8b-7d46-413f-8997-6ac4285fa114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (0d197768-b346-4ea0-8b70-b6cd017a339e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-af0c1e47-9710-4269-b7a0-48532e9500b8 tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:34:13 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231" returned: 0 in 0.518s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:13 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231 Nov 03 18:34:13 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Flow 'volume_create_manager' (724f7f15-d327-4116-a56c-fa0b30039808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd62edd2-6910-4bf2-b14e-73e5320e86aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd62edd2-6910-4bf2-b14e-73e5320e86aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47ac579-4027-4ee2-ab41-18365f0bad81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f50f9599744aeda5df25bb72edfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:13Z,use_quota=True,user_id='beebd21295d74b13ba276b4fe07d7c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6cdf103-70c5-4238-a7bb-bcf4b6ca6143),volume_type_id=f6cdf103-70c5-4238-a7bb-bcf4b6ca6143)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084e9620-e4e0-4562-87e3-39e7becc76ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084e9620-e4e0-4562-87e3-39e7becc76ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b389fdd-dc09-4a1d-9a49-b5843b3ca582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:34:13 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5f5b0b1f-cc9e-4236-86bf-5f313e60f231" returned: 0 in 0.329s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Lock "cinder-quobyte-5f5b0b1f-cc9e-4236-86bf-5f313e60f231" released by "delete_volume" :: held 0.904s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Created reservations ['9e8d59a0-73ee-49f3-8be1-bfcc183d1e6e', 'a6de07e2-dbb6-4f7f-ae5e-c5ef58db861e', '01e9754c-43af-498c-b561-f4ba62bca380', '9cc65bd0-800b-47d4-ac17-607eb10304c9'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:13 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:13 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b389fdd-dc09-4a1d-9a49-b5843b3ca582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e47ac579-4027-4ee2-ab41-18365f0bad81', 'volume_name': 'volume-e47ac579-4027-4ee2-ab41-18365f0bad81', 'volume_size': 1, 'image_id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d773a286-f8fa-4967-b939-94b4826be9ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '394edc94c973a6fab8e623cc233688fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26f50f9599744aeda5df25bb72edfa63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ab2d3f875796867113b15a294239325aa2056d162a7073cfea6448c3b4dd93094d95bbedac87a63842b70dfabc6dac01e65309611dcef8934872fc5a572eb48', 'id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'created_at': datetime.datetime(2026, 11, 3, 17, 34, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 34, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d773a286-f8fa-4967-b939-94b4826be9ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef37854d-308c-42e3-8bb2-1c9f2a419879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef37854d-308c-42e3-8bb2-1c9f2a419879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df1d977-a8e6-481c-a84f-e03130f67379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Volume e47ac579-4027-4ee2-ab41-18365f0bad81: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e47ac579-4027-4ee2-ab41-18365f0bad81', 'volume_size': 1, 'image_id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d773a286-f8fa-4967-b939-94b4826be9ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '394edc94c973a6fab8e623cc233688fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26f50f9599744aeda5df25bb72edfa63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ab2d3f875796867113b15a294239325aa2056d162a7073cfea6448c3b4dd93094d95bbedac87a63842b70dfabc6dac01e65309611dcef8934872fc5a572eb48', 'id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'created_at': datetime.datetime(2026, 11, 3, 17, 34, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 34, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d773a286-f8fa-4967-b939-94b4826be9ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Trying to clone e47ac579-4027-4ee2-ab41-18365f0bad81 from image d773a286-f8fa-4967-b939-94b4826be9ce at location (None, [{'url': 'file:///opt/stack/data/glance/images/d773a286-f8fa-4967-b939-94b4826be9ce', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:34:14 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Image download 0.00 MB at 0.00 MB/s Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:14 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (00148333-77a5-4354-80f1-fe866b43dc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a9018c-f5e2-4798-83c4-6a2829096968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.563s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Deleted volume successfully. Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14fbcc4-55a5-4e1e-97a5-515300db2736]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4a9018c-f5e2-4798-83c4-6a2829096968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-961632326',display_name='tempest-VolumesGetTest-Volume-1247242739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8488ef-19c6-4560-bd8c-e5fb37646b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:14Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadc1baf-bce1-461f-92aa-d31e36a82617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aadc1baf-bce1-461f-92aa-d31e36a82617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d917d1-db44-4aef-8869-05186f464664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d917d1-db44-4aef-8869-05186f464664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8488ef-19c6-4560-bd8c-e5fb37646b08', 'volume_name': 'volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79b295b-8b80-4cbe-b287-3dbf62630abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79b295b-8b80-4cbe-b287-3dbf62630abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff5e1e2-89b4-40f0-8ffe-70a06ee10a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Volume 8a8488ef-19c6-4560-bd8c-e5fb37646b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08', 'volume_size': 1} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-961632326',display_name='tempest-VolumesGetTest-Volume-1247242739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8488ef-19c6-4560-bd8c-e5fb37646b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff6c540239804b1aa31848f07717d9bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:14Z,use_quota=True,user_id='8126d5b052814304b2dc8f9ff56d429c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Creating volume 8a8488ef-19c6-4560-bd8c-e5fb37646b08 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:14 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4c7b0c5f-d47e-477e-a585-498177f7e9ea tempest-ProjectReaderTests-283321100 None] Lock "cinder-5f5b0b1f-cc9e-4236-86bf-5f313e60f231-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:14 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 1073741824 Nov 03 18:34:14 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:14 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD Nov 03 18:34:14 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:14 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:14 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD Nov 03 18:34:14 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:14 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 1073741824" returned: 0 in 0.571s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:15 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 Nov 03 18:34:15 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:15 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD" returned: 1 in 0.431s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Temporary image d773a286-f8fa-4967-b939-94b4826be9ce is fetched for user beebd21295d74b13ba276b4fe07d7c6f. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855038c-6bfe-4076-8210-1eec1dc2b00f]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:15 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08" returned: 0 in 0.356s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff5e1e2-89b4-40f0-8ffe-70a06ee10a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808f7f98-349a-4226-9a7f-319c17216af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:15 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Volume volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 (8a8488ef-19c6-4560-bd8c-e5fb37646b08): created successfully Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808f7f98-349a-4226-9a7f-319c17216af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Flow 'volume_create_manager' (00148333-77a5-4354-80f1-fe866b43dc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-17ab03d3-447f-45af-bfdb-8a9219730d30 tempest-VolumesGetTest-1506660734 None] Created volume successfully. Nov 03 18:34:15 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD Nov 03 18:34:15 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:15 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:15 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD Nov 03 18:34:15 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:16 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47ac579-4027-4ee2-ab41-18365f0bad81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f50f9599744aeda5df25bb72edfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:13Z,use_quota=True,user_id='beebd21295d74b13ba276b4fe07d7c6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6cdf103-70c5-4238-a7bb-bcf4b6ca6143),volume_type_id=f6cdf103-70c5-4238-a7bb-bcf4b6ca6143)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Creating volume e47ac579-4027-4ee2-ab41-18365f0bad81 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:16 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:16 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 1073741824 Nov 03 18:34:16 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-8a8488ef-19c6-4560-bd8c-e5fb37646b08-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Lock "cinder-8a8488ef-19c6-4560-bd8c-e5fb37646b08-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-8a8488ef-19c6-4560-bd8c-e5fb37646b08" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-8a8488ef-19c6-4560-bd8c-e5fb37646b08" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80648b2-82ba-4ef6-96d6-27c7c7d9e6a1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:16 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 1073741824" returned: 0 in 0.618s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:16 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 Nov 03 18:34:16 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:16 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 Nov 03 18:34:16 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:17 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Flow 'volume_create_manager' (b5b89157-c9ec-4746-bc90-0fe0eb608d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8fc41e-6eae-491f-a688-fd09a2abdd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81" returned: 0 in 0.423s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:17 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8fc41e-6eae-491f-a688-fd09a2abdd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-961449309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273b8d55-dbf1-4d2b-ad5f-73d147b0c017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648e2bfd88f546f49a4832a7ecb6aed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:17Z,use_quota=True,user_id='8501ceebdd7d493aa74227aee40e0198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69505ed-f3f1-4962-91c8-1327bcdce8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69505ed-f3f1-4962-91c8-1327bcdce8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4516dfa4-7bcd-4cbe-9c6c-31dc6e2d8e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4516dfa4-7bcd-4cbe-9c6c-31dc6e2d8e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '273b8d55-dbf1-4d2b-ad5f-73d147b0c017', 'volume_name': 'volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6442516-e7a9-4bbb-b5e9-9a5ae0f4e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6442516-e7a9-4bbb-b5e9-9a5ae0f4e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e4522-bfb4-4a82-822c-201a303c9bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:17 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Volume 273b8d55-dbf1-4d2b-ad5f-73d147b0c017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017', 'volume_size': 1} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-961449309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273b8d55-dbf1-4d2b-ad5f-73d147b0c017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648e2bfd88f546f49a4832a7ecb6aed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:17Z,use_quota=True,user_id='8501ceebdd7d493aa74227aee40e0198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Creating volume 273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:17 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08" returned: 0 in 0.593s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:17 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 1073741824 Nov 03 18:34:17 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Attempting download of d773a286-f8fa-4967-b939-94b4826be9ce ((None, [{'url': 'file:///opt/stack/data/glance/images/d773a286-f8fa-4967-b939-94b4826be9ce', 'metadata': {}}])) to volume e47ac579-4027-4ee2-ab41-18365f0bad81. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:34:17 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08 Nov 03 18:34:17 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[711af124-6c00-4cda-bef5-27dc8f19a66b]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:17 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n Nov 03 18:34:17 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:17 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8a8488ef-19c6-4560-bd8c-e5fb37646b08" returned: 0 in 0.359s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-8a8488ef-19c6-4560-bd8c-e5fb37646b08" released by "delete_volume" :: held 1.011s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Created reservations ['cc79c099-8c40-45ee-aef7-5c384d3ff40f', '706b537b-0666-41b3-b6b1-e7c519700db5', '1a0cfed4-240a-46bd-a90d-887a4dff22f7', '85ba43c1-f196-4d70-aa21-0ddcbcd99285'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:17 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n" returned: 0 in 0.481s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:17 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:17 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:17 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 1073741824" returned: 0 in 0.631s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:17 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 Nov 03 18:34:17 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:17 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n Nov 03 18:34:17 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:18 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.295s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a730a91e-90c9-4b35-995d-005e9c6e1463 tempest-VolumesGetTest-1506660734 None] Lock "cinder-8a8488ef-19c6-4560-bd8c-e5fb37646b08-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:18 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n" returned: 1 in 0.404s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d773a286-f8fa-4967-b939-94b4826be9ce_hbfslx_n' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:34:18 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[34340edb-4cb9-4896-97b1-218543d81298]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5e4522-bfb4-4a82-822c-201a303c9bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48440cdf-d167-42a0-be15-aea0bd3e63db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:18 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Volume volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 (273b8d55-dbf1-4d2b-ad5f-73d147b0c017): created successfully Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48440cdf-d167-42a0-be15-aea0bd3e63db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Flow 'volume_create_manager' (b5b89157-c9ec-4746-bc90-0fe0eb608d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-82fd5076-8831-4120-8045-5f7c8ee22f9d req-0f5450be-c250-49db-9df2-aba226305382 tempest-VolumesSnapshotsTestJSON-1757557014 None] Created volume successfully. Nov 03 18:34:18 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD Nov 03 18:34:18 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:18 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:18 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD Nov 03 18:34:18 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Lock "cinder-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:18 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Acquiring lock "cinder-quobyte-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] d773a286-f8fa-4967-b939-94b4826be9ce was raw, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" acquired by "delete_volume" :: waited 0.039s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:19 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 Nov 03 18:34:19 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ead524-db67-4dd1-8d25-7fdf39f6c344]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:19 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c Nov 03 18:34:19 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:19 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" returned: 0 in 0.441s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:19 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c Nov 03 18:34:19 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:19 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81" returned: 0 in 0.612s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d773a286-f8fa-4967-b939-94b4826be9ce_2be19c84devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:34:19 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:19 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 1G Nov 03 18:34:19 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Creating offline snapshot 75866272-62a2-4ac2-9a46-941da7f6ef28 of volume 273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c55c4d-7f96-48fe-9e6b-a16ad4e2a11d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:19 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 Nov 03 18:34:19 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:19 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" returned: 0 in 0.421s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Lock "cinder-quobyte-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c" released by "delete_volume" :: held 0.924s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Created reservations ['236693fe-135f-4559-ba74-ca82c334f6b1', 'c5c4c260-3728-4d5a-a004-789ae8926d69', '5d56080e-22dc-4eac-aa6a-166bdb5c9395', '8d171731-e4e8-4ada-98dc-223b4a7cbeac'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:20 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 1G" returned: 0 in 0.573s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Downloaded image d773a286-f8fa-4967-b939-94b4826be9ce ((None, [{'url': 'file:///opt/stack/data/glance/images/d773a286-f8fa-4967-b939-94b4826be9ce', 'metadata': {}}])) to volume e47ac579-4027-4ee2-ab41-18365f0bad81 successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Temporary image d773a286-f8fa-4967-b939-94b4826be9ce for user beebd21295d74b13ba276b4fe07d7c6f is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Marking volume e47ac579-4027-4ee2-ab41-18365f0bad81 as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Copying metadata from image d773a286-f8fa-4967-b939-94b4826be9ce to e47ac579-4027-4ee2-ab41-18365f0bad81. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Creating volume glance metadata for volume e47ac579-4027-4ee2-ab41-18365f0bad81 backed by image d773a286-f8fa-4967-b939-94b4826be9ce with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '394edc94c973a6fab8e623cc233688fe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:34:20 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:20 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df1d977-a8e6-481c-a84f-e03130f67379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47ac579-4027-4ee2-ab41-18365f0bad81', 'volume_size': 1, 'image_id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d773a286-f8fa-4967-b939-94b4826be9ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '394edc94c973a6fab8e623cc233688fe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '26f50f9599744aeda5df25bb72edfa63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7ab2d3f875796867113b15a294239325aa2056d162a7073cfea6448c3b4dd93094d95bbedac87a63842b70dfabc6dac01e65309611dcef8934872fc5a572eb48', 'id': 'd773a286-f8fa-4967-b939-94b4826be9ce', 'created_at': datetime.datetime(2026, 11, 3, 17, 34, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 34, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d773a286-f8fa-4967-b939-94b4826be9ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94167366-6ad2-442e-a0ff-9acedd8454ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:20 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" returned: 0 in 0.545s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Volume volume-e47ac579-4027-4ee2-ab41-18365f0bad81 (e47ac579-4027-4ee2-ab41-18365f0bad81): created successfully Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94167366-6ad2-442e-a0ff-9acedd8454ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Flow 'volume_create_manager' (724f7f15-d327-4116-a56c-fa0b30039808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:20 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 1G Nov 03 18:34:20 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3bc950a4-48f2-4021-a50a-b1432f8046ce tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Created volume successfully. Nov 03 18:34:20 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.300s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Deleted volume successfully. Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ecd212a2-10cd-4e28-b035-735c2025d644 tempest-VolumesGetTest-1506660734 None] Lock "cinder-e3cee30c-7a08-4e8b-89d0-39a6fbde4d3c-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:20 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 1G" returned: 0 in 0.482s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:20 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Acquiring lock "cinder-e47ac579-4027-4ee2-ab41-18365f0bad81-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:20 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "cinder-e47ac579-4027-4ee2-ab41-18365f0bad81-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Acquiring lock "cinder-quobyte-e47ac579-4027-4ee2-ab41-18365f0bad81" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "cinder-quobyte-e47ac579-4027-4ee2-ab41-18365f0bad81" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b1277c-a1b4-4039-8b6b-8fbe3d6fd845]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:21 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 Nov 03 18:34:21 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:21 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:21 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 is being set with open permissions: ugo+rw Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:21 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 Nov 03 18:34:21 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:21 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81" returned: 0 in 0.565s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:21 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28" returned: 0 in 0.357s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:21 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81 Nov 03 18:34:21 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:21 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info Nov 03 18:34:21 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:21 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e47ac579-4027-4ee2-ab41-18365f0bad81" returned: 0 in 0.339s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "cinder-quobyte-e47ac579-4027-4ee2-ab41-18365f0bad81" released by "delete_volume" :: held 0.971s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:21 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info" returned: 0 in 0.329s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:21 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info is being set with open permissions: ugo+rw Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:21 devstack cinder-volume[86841]: WARNING cinder.quota [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:34:21 devstack cinder-volume[86841]: WARNING cinder.quota [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:34:21 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info Nov 03 18:34:21 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:21 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Created reservations ['b3aeb282-ec71-4d0b-860e-dc48df7e680c', '8f076f25-aa0a-4e5b-bcd8-d607fdf892a4', 'cdf5051c-6f97-47f8-a071-9eda50dca5fe', '46b3be46-3dce-4e93-980c-a1ed59aedac5'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:22 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:22 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:22 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.info" returned: 0 in 0.287s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-1ee0bf69-603e-4e1b-ba90-e07edf9c7925 req-acc15586-ff5c-42ae-9e20-d9aa71c4f05c tempest-VolumesSnapshotsTestJSON-1757557014 None] Create snapshot completed successfully Nov 03 18:34:22 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.453s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Deleted volume successfully. Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c1abb262-c2b7-4c9c-bf43-cc75dbfe9cef tempest-VolumeAndVolumeTypeFromImageTest-1090268751 None] Lock "cinder-e47ac579-4027-4ee2-ab41-18365f0bad81-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "cinder-75866272-62a2-4ac2-9a46-941da7f6ef28-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-75866272-62a2-4ac2-9a46-941da7f6ef28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "cinder-quobyte-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-quobyte-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "cinder-quobyte-75866272-62a2-4ac2-9a46-941da7f6ef28" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-quobyte-75866272-62a2-4ac2-9a46-941da7f6ef28" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Deleting offline snapshot 75866272-62a2-4ac2-9a46-941da7f6ef28 of volume 273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] snapshot_file for this snap is: volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6611d-728d-4287-96fe-e2634a65698a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:22 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 Nov 03 18:34:22 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:23 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28" returned: 0 in 0.412s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:34:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[627201d0-4942-44c6-8ff3-e5918dc3b0d9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:23 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 Nov 03 18:34:23 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:23 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" returned: 0 in 0.528s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:23 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 Nov 03 18:34:23 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:24 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28" returned: 0 in 0.446s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:24 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28 Nov 03 18:34:24 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:24 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017.75866272-62a2-4ac2-9a46-941da7f6ef28" returned: 0 in 0.324s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-quobyte-75866272-62a2-4ac2-9a46-941da7f6ef28" released by "_delete_snapshot" :: held 1.889s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-quobyte-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" released by "delete_snapshot" :: held 1.935s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG cinder.quota [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Created reservations ['f0402716-7c2b-4e7c-876c-b73ef7c7d7d6', '45e12104-d7e9-4464-ad69-830b3c199156', 'c77f9fc6-1ba3-4f94-aac6-4aa5609285e2', 'e6547130-c060-48c9-a164-f45c91334042'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Delete snapshot completed successfully. Nov 03 18:34:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-163d9864-03be-4af1-b9e6-80e5e3a8b67d req-cc94bf68-18bb-4392-85fa-af0aa339befd tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-75866272-62a2-4ac2-9a46-941da7f6ef28-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "cinder-273b8d55-dbf1-4d2b-ad5f-73d147b0c017-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-273b8d55-dbf1-4d2b-ad5f-73d147b0c017-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "cinder-quobyte-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-quobyte-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f95813f-75fd-484d-a7e7-1da5ead50b03]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:25 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 Nov 03 18:34:25 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:25 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" returned: 0 in 0.582s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:25 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017 Nov 03 18:34:25 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:26 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" returned: 0 in 0.356s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-quobyte-273b8d55-dbf1-4d2b-ad5f-73d147b0c017" released by "delete_volume" :: held 1.037s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG cinder.quota [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Created reservations ['fbd722ff-448e-435e-886e-695221b304eb', '86f49a65-95be-43ae-ab69-28ae007a6223', '0d4fad1c-6a3f-4847-8544-e152c5ad888d', 'dc96066a-520a-4166-a693-f209a8055945'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:26 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:26 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:26 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.399s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG cinder.manager [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Deleted volume successfully. Nov 03 18:34:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-935d793f-9be0-4c37-a41b-7ff693e199a7 req-920be2df-92de-4754-bb5e-46fbbf6e626f tempest-VolumesSnapshotsTestJSON-1757557014 None] Lock "cinder-273b8d55-dbf1-4d2b-ad5f-73d147b0c017-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Flow 'volume_create_manager' (02f1202d-0401-41b5-871d-7cb3d4564401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7169dd-31a2-43ef-b582-3cdee9abdeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7169dd-31a2-43ef-b582-3cdee9abdeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1933281906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13dd274-2b19-4e9e-9197-4878ff01c691,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5437acb862bb454791f552507f021be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:27Z,use_quota=True,user_id='e6d35da8922542d8b2ba216511743d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aeade1-8a6f-4953-af04-e0a8f7e1cd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aeade1-8a6f-4953-af04-e0a8f7e1cd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b479c28d-76e3-41c7-9ca3-8f596e0af803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b479c28d-76e3-41c7-9ca3-8f596e0af803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b13dd274-2b19-4e9e-9197-4878ff01c691', 'volume_name': 'volume-b13dd274-2b19-4e9e-9197-4878ff01c691', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a021f541-794d-4bcb-84e7-96b0f497684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a021f541-794d-4bcb-84e7-96b0f497684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91014c14-6d52-4483-ba6c-148df58e8159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:27 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Volume b13dd274-2b19-4e9e-9197-4878ff01c691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b13dd274-2b19-4e9e-9197-4878ff01c691', 'volume_size': 1} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1933281906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b13dd274-2b19-4e9e-9197-4878ff01c691,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5437acb862bb454791f552507f021be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:27Z,use_quota=True,user_id='e6d35da8922542d8b2ba216511743d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Creating volume b13dd274-2b19-4e9e-9197-4878ff01c691 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:27 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:27 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 1073741824 Nov 03 18:34:27 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:28 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 1073741824" returned: 0 in 0.580s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:28 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 Nov 03 18:34:28 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:28 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91014c14-6d52-4483-ba6c-148df58e8159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b13dd274-2b19-4e9e-9197-4878ff01c691', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c49cd8c-8de0-41e7-9fd4-516befff0e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:28 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Volume volume-b13dd274-2b19-4e9e-9197-4878ff01c691 (b13dd274-2b19-4e9e-9197-4878ff01c691): created successfully Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c49cd8c-8de0-41e7-9fd4-516befff0e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Flow 'volume_create_manager' (02f1202d-0401-41b5-871d-7cb3d4564401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-45bfdfc6-aeab-4031-9cd1-fec21cdd8499 tempest-VolumesListTestJSON-1341439429 None] Created volume successfully. Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (c449a434-37d7-45b5-8d62-154e4505313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4d292f-e0f2-47ef-8e81-69467948607d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a4d292f-e0f2-47ef-8e81-69467948607d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080012156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21f8e37-00db-4f40-8e4b-63f061ffd9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:30Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6a0d24-df1a-4c75-b504-d29110f69e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6a0d24-df1a-4c75-b504-d29110f69e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115d2dcf-000e-4adb-8f25-da5eb1104d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (115d2dcf-000e-4adb-8f25-da5eb1104d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21f8e37-00db-4f40-8e4b-63f061ffd9f0', 'volume_name': 'volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec7aac-2aad-4e11-876e-3ff7aff32deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec7aac-2aad-4e11-876e-3ff7aff32deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a15515-16a5-446a-b2b0-80b468e9bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume b21f8e37-00db-4f40-8e4b-63f061ffd9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0', 'volume_size': 1} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2080012156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21f8e37-00db-4f40-8e4b-63f061ffd9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:30Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Creating volume b21f8e37-00db-4f40-8e4b-63f061ffd9f0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:29 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:29 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 1073741824 Nov 03 18:34:29 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Flow 'volume_create_manager' (d25075ef-f3c8-4899-b844-7c7193f72700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbd4efe-1abf-4a38-8af6-a9533e5ea603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbd4efe-1abf-4a38-8af6-a9533e5ea603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-99675589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52d5943-cb6f-4e59-9ca7-9874d19d5a1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5437acb862bb454791f552507f021be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:30Z,use_quota=True,user_id='e6d35da8922542d8b2ba216511743d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a7e7b5-6549-4058-8c3b-6d390e7d0927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a7e7b5-6549-4058-8c3b-6d390e7d0927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194f1c9b-2cc4-4894-a4ca-ae93ed1d07cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194f1c9b-2cc4-4894-a4ca-ae93ed1d07cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52d5943-cb6f-4e59-9ca7-9874d19d5a1b', 'volume_name': 'volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66058e4f-c1cf-4a02-a703-b1bb43e55b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66058e4f-c1cf-4a02-a703-b1bb43e55b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9677ecee-a71f-425d-8035-6d59e7fe3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Volume d52d5943-cb6f-4e59-9ca7-9874d19d5a1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b', 'volume_size': 1} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:30 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 1073741824" returned: 0 in 0.674s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:30 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 Nov 03 18:34:30 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:30 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0" returned: 0 in 0.269s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-99675589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52d5943-cb6f-4e59-9ca7-9874d19d5a1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5437acb862bb454791f552507f021be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:30Z,use_quota=True,user_id='e6d35da8922542d8b2ba216511743d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Creating volume d52d5943-cb6f-4e59-9ca7-9874d19d5a1b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:30 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a15515-16a5-446a-b2b0-80b468e9bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4daf5b-947c-490a-81f7-135461753aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:30 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b 1073741824 Nov 03 18:34:30 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 (b21f8e37-00db-4f40-8e4b-63f061ffd9f0): created successfully Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4daf5b-947c-490a-81f7-135461753aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (c449a434-37d7-45b5-8d62-154e4505313d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-79de9295-5e42-44cc-ac58-901b6f82ca62 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created volume successfully. Nov 03 18:34:31 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b 1073741824" returned: 0 in 0.591s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:31 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b Nov 03 18:34:31 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:31 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b" returned: 0 in 0.342s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9677ecee-a71f-425d-8035-6d59e7fe3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc998eb9-379a-47e8-bad7-bbc8bf1bf2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:32 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Volume volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b (d52d5943-cb6f-4e59-9ca7-9874d19d5a1b): created successfully Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc998eb9-379a-47e8-bad7-bbc8bf1bf2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Flow 'volume_create_manager' (d25075ef-f3c8-4899-b844-7c7193f72700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bc6f20d5-7562-46cd-9654-82f38ddecad9 tempest-VolumesListTestJSON-1341439429 None] Created volume successfully. Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (8e1476a3-7280-494c-84ef-f105ee408ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d546e1e-00f5-4be9-aa01-dd764896d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d546e1e-00f5-4be9-aa01-dd764896d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681100112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ca97bd-8ee1-474c-9255-6f4a1915f1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:32Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1f8790-67f6-4ef1-9b3b-0b4b52c68f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1f8790-67f6-4ef1-9b3b-0b4b52c68f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d469e96-7934-454e-bb3f-5ba9b9cfdfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d469e96-7934-454e-bb3f-5ba9b9cfdfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ca97bd-8ee1-474c-9255-6f4a1915f1f9', 'volume_name': 'volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4854bbf-e2c3-4fa4-b969-d7578aed8258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4854bbf-e2c3-4fa4-b969-d7578aed8258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eb2733-c7b3-401e-b39b-94d25e66670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:32 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume 75ca97bd-8ee1-474c-9255-6f4a1915f1f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9', 'volume_size': 1} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681100112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ca97bd-8ee1-474c-9255-6f4a1915f1f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:32Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Creating volume 75ca97bd-8ee1-474c-9255-6f4a1915f1f9 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:32 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:32 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 1073741824 Nov 03 18:34:32 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (ac4ab293-e3ed-418f-a7d6-a73011e1c5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3631e7-5b64-4970-806f-92a019d58b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d3631e7-5b64-4970-806f-92a019d58b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750572596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa3aafb-732f-43fe-b179-d4ea9c20f91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:33Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0d4b51-705b-47fd-a80a-c4307fd7f0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0d4b51-705b-47fd-a80a-c4307fd7f0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f566fa0b-18e6-44f9-90f9-c50a22a6ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f566fa0b-18e6-44f9-90f9-c50a22a6ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa3aafb-732f-43fe-b179-d4ea9c20f91b', 'volume_name': 'volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885a73a4-547d-42d8-b1e8-603568aef9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885a73a4-547d-42d8-b1e8-603568aef9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fd9ba6-074b-40bf-bfd4-1e5d23c1289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume 1aa3aafb-732f-43fe-b179-d4ea9c20f91b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b', 'volume_size': 1} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:33 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 1073741824" returned: 0 in 0.882s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:33 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 Nov 03 18:34:33 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (f2062a23-74f9-4868-93b4-02a658b4ee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2d0c24-3dd1-4979-af04-3287bfb44840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2d0c24-3dd1-4979-af04-3287bfb44840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246596302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cfbc4c-5f03-4e7c-aef2-499121585c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:34Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8679c689-8ca8-421e-be12-f912d0278bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8679c689-8ca8-421e-be12-f912d0278bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b291a3-be39-4660-9dad-643bd39bc70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b291a3-be39-4660-9dad-643bd39bc70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cfbc4c-5f03-4e7c-aef2-499121585c78', 'volume_name': 'volume-17cfbc4c-5f03-4e7c-aef2-499121585c78', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35a1f21-da34-4111-a7fd-a469ea77e456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35a1f21-da34-4111-a7fd-a469ea77e456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0993f3d8-2679-4d73-acbf-8d1651c4ac71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:33 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume 17cfbc4c-5f03-4e7c-aef2-499121585c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cfbc4c-5f03-4e7c-aef2-499121585c78', 'volume_size': 1} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:33 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9" returned: 0 in 0.401s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-750572596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa3aafb-732f-43fe-b179-d4ea9c20f91b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:33Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Creating volume 1aa3aafb-732f-43fe-b179-d4ea9c20f91b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:33 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:33 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b 1073741824 Nov 03 18:34:33 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87eb2733-c7b3-401e-b39b-94d25e66670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:33 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc0dc24-a106-470a-904c-a827ed9112b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-35427aee-560b-4fce-ac47-f0940531e9b5 tempest-BackendsCapabilitiesAdminTestsJSON-1023457213 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86841) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 (75ca97bd-8ee1-474c-9255-6f4a1915f1f9): created successfully Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc0dc24-a106-470a-904c-a827ed9112b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (8e1476a3-7280-494c-84ef-f105ee408ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Flow 'volume_create_manager' (8b93ed73-412f-4f29-9879-4ebbfbe7c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d15f0d-3eaf-430d-8ff6-1b6621fe9209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5b323803-9ac1-4961-b9e4-2932adb77b4d tempest-BackendsCapabilitiesAdminTestsJSON-1023457213 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86841) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-beeecfee-5b99-4a57-baf3-66f77c5b08b0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created volume successfully. Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64d15f0d-3eaf-430d-8ff6-1b6621fe9209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1776970345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3b9cee-83a1-4513-bcb2-5611e49847c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5437acb862bb454791f552507f021be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:34Z,use_quota=True,user_id='e6d35da8922542d8b2ba216511743d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5ffb76-d3bc-49c8-99d1-4296fccf8028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5ffb76-d3bc-49c8-99d1-4296fccf8028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dfc847-e535-498b-8efd-14713fbfd781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dfc847-e535-498b-8efd-14713fbfd781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3b9cee-83a1-4513-bcb2-5611e49847c9', 'volume_name': 'volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7444295a-28d1-4fb1-845b-8f8a51317609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7444295a-28d1-4fb1-845b-8f8a51317609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c983738-60b0-47ad-878e-84a9b02d17a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Volume ae3b9cee-83a1-4513-bcb2-5611e49847c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9', 'volume_size': 1} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (d4f4a6e5-1e81-4621-814e-3a1ddec01d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc6885-0b9d-42ce-b958-4ea4ee78d5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dc6885-0b9d-42ce-b958-4ea4ee78d5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902646490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6793aabe-785e-43fe-8e9d-dec88a0564ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:34Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb8b246-bdd0-406d-9952-9dcd96678f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb8b246-bdd0-406d-9952-9dcd96678f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404364eb-8bf2-451c-9088-da406084c7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (404364eb-8bf2-451c-9088-da406084c7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6793aabe-785e-43fe-8e9d-dec88a0564ea', 'volume_name': 'volume-6793aabe-785e-43fe-8e9d-dec88a0564ea', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3598af8a-75ad-4b71-9d86-6be76f166131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3598af8a-75ad-4b71-9d86-6be76f166131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c09f17-17d2-43d1-aa57-ac39e0722448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume 6793aabe-785e-43fe-8e9d-dec88a0564ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6793aabe-785e-43fe-8e9d-dec88a0564ea', 'volume_size': 1} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:34 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b 1073741824" returned: 0 in 0.716s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:34 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b Nov 03 18:34:34 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (f858919a-77f8-4da3-8c31-beb39118815d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e992b555-fdc1-42e3-9254-4e4dbe134b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e992b555-fdc1-42e3-9254-4e4dbe134b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117482894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc93c14-caf8-44bd-ae14-f113d273f43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:35Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7f5c21-fa18-4004-a258-4949faf69b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7f5c21-fa18-4004-a258-4949faf69b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908d9749-a850-47f3-a6c4-1c7f5046e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908d9749-a850-47f3-a6c4-1c7f5046e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc93c14-caf8-44bd-ae14-f113d273f43c', 'volume_name': 'volume-bdc93c14-caf8-44bd-ae14-f113d273f43c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e55197-22a9-4a91-a0f7-6d090395ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e55197-22a9-4a91-a0f7-6d090395ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5073c6f-a360-4a64-9508-bf9bfca099fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume bdc93c14-caf8-44bd-ae14-f113d273f43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc93c14-caf8-44bd-ae14-f113d273f43c', 'volume_size': 1} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:34 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246596302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cfbc4c-5f03-4e7c-aef2-499121585c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:34Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Creating volume 17cfbc4c-5f03-4e7c-aef2-499121585c78 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fd9ba6-074b-40bf-bfd4-1e5d23c1289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d39eacc-347f-4f22-9c7f-b1010e4a1508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:34 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 1073741824 Nov 03 18:34:34 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b (1aa3aafb-732f-43fe-b179-d4ea9c20f91b): created successfully Nov 03 18:34:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d39eacc-347f-4f22-9c7f-b1010e4a1508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (ac4ab293-e3ed-418f-a7d6-a73011e1c5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c28d3d41-80c5-41e2-9a28-76d76c6e833b tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created volume successfully. Nov 03 18:34:35 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 1073741824" returned: 0 in 0.513s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:35 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 Nov 03 18:34:35 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:35 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78" returned: 0 in 0.307s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.553s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1776970345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3b9cee-83a1-4513-bcb2-5611e49847c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5437acb862bb454791f552507f021be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:34Z,use_quota=True,user_id='e6d35da8922542d8b2ba216511743d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Creating volume ae3b9cee-83a1-4513-bcb2-5611e49847c9 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:35 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:35 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 1073741824 Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0993f3d8-2679-4d73-acbf-8d1651c4ac71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cfbc4c-5f03-4e7c-aef2-499121585c78', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:35 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a80714a-b0b3-4d01-b09e-57ae8cbbf58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:35 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 (17cfbc4c-5f03-4e7c-aef2-499121585c78): created successfully Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a80714a-b0b3-4d01-b09e-57ae8cbbf58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (f2062a23-74f9-4868-93b4-02a658b4ee9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3b88c242-2983-41aa-b2e9-06ea55c99505 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created volume successfully. Nov 03 18:34:36 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 1073741824" returned: 0 in 0.574s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=158,cinder:UPDATE=195,cinder:INSERT=50,cinder:DELETE=20 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:36 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 Nov 03 18:34:36 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:36 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9" returned: 0 in 0.278s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902646490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6793aabe-785e-43fe-8e9d-dec88a0564ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:34Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Creating volume 6793aabe-785e-43fe-8e9d-dec88a0564ea {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:36 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c983738-60b0-47ad-878e-84a9b02d17a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:36 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea 1073741824 Nov 03 18:34:36 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea843d96-9a36-4c5c-bbcf-59cd78a2b751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:36 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Volume volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 (ae3b9cee-83a1-4513-bcb2-5611e49847c9): created successfully Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea843d96-9a36-4c5c-bbcf-59cd78a2b751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Flow 'volume_create_manager' (8b93ed73-412f-4f29-9879-4ebbfbe7c665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:36 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-70078d98-3a78-49fa-9892-0ecbd20793b6 tempest-VolumesListTestJSON-1341439429 None] Created volume successfully. Nov 03 18:34:37 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea 1073741824" returned: 0 in 0.705s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=205,cinder:INSERT=66,cinder:SELECT=153,cinder:DELETE=14 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:37 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea Nov 03 18:34:37 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:37 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea" returned: 0 in 0.395s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-117482894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc93c14-caf8-44bd-ae14-f113d273f43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e432c5f04f4eb594a3e6535eb611d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:35Z,use_quota=True,user_id='123380d691874ee6a0fbc8a819f0bac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Creating volume bdc93c14-caf8-44bd-ae14-f113d273f43c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:37 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:37 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c 1073741824 Nov 03 18:34:37 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c09f17-17d2-43d1-aa57-ac39e0722448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6793aabe-785e-43fe-8e9d-dec88a0564ea', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed94f24d-2bca-40cb-a190-08ef02768bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:38 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume volume-6793aabe-785e-43fe-8e9d-dec88a0564ea (6793aabe-785e-43fe-8e9d-dec88a0564ea): created successfully Nov 03 18:34:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed94f24d-2bca-40cb-a190-08ef02768bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:38 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (d4f4a6e5-1e81-4621-814e-3a1ddec01d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3df62f23-72b7-487f-ab2c-ea98bc4958db tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created volume successfully. Nov 03 18:34:38 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c 1073741824" returned: 0 in 0.710s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:38 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c Nov 03 18:34:38 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:39 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5073c6f-a360-4a64-9508-bf9bfca099fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc93c14-caf8-44bd-ae14-f113d273f43c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7a7108-5873-4743-8eb1-163389b23ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:39 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Volume volume-bdc93c14-caf8-44bd-ae14-f113d273f43c (bdc93c14-caf8-44bd-ae14-f113d273f43c): created successfully Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7a7108-5873-4743-8eb1-163389b23ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Flow 'volume_create_manager' (f858919a-77f8-4da3-8c31-beb39118815d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:39 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a9cd41e3-1ff6-4483-8fb1-822aef564ca0 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created volume successfully. Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-bdc93c14-caf8-44bd-ae14-f113d273f43c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-bdc93c14-caf8-44bd-ae14-f113d273f43c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-quobyte-bdc93c14-caf8-44bd-ae14-f113d273f43c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-bdc93c14-caf8-44bd-ae14-f113d273f43c" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[47035b11-ce20-430f-93d0-2eeefb49f66c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:39 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c Nov 03 18:34:39 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:40 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:40 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c Nov 03 18:34:40 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:40 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bdc93c14-caf8-44bd-ae14-f113d273f43c" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-bdc93c14-caf8-44bd-ae14-f113d273f43c" released by "delete_volume" :: held 0.863s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created reservations ['29cf57a6-907c-44f7-86fe-0868351a2265', '7365670f-4832-4643-9582-f78f710112e6', '5d177983-6595-4d0f-a756-2d70597c0efe', '7d1ee5c8-a884-4612-8de7-4d512f7faab4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "cinder-ae3b9cee-83a1-4513-bcb2-5611e49847c9-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:40 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:40 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-ae3b9cee-83a1-4513-bcb2-5611e49847c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-6793aabe-785e-43fe-8e9d-dec88a0564ea-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-6793aabe-785e-43fe-8e9d-dec88a0564ea-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "cinder-quobyte-ae3b9cee-83a1-4513-bcb2-5611e49847c9" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-quobyte-ae3b9cee-83a1-4513-bcb2-5611e49847c9" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-quobyte-6793aabe-785e-43fe-8e9d-dec88a0564ea" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da242ec-8916-44b6-a43f-239460996976]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-6793aabe-785e-43fe-8e9d-dec88a0564ea" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf137b5-7878-4473-be39-f59e74ae12ec]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:41 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.413s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:41 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 Nov 03 18:34:41 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Deleted volume successfully. Nov 03 18:34:41 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea Nov 03 18:34:41 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-009fbdcc-5e71-4f2d-b31d-48f0af2c4c2f tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-bdc93c14-caf8-44bd-ae14-f113d273f43c-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:41 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea" returned: 0 in 0.479s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:41 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea Nov 03 18:34:41 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:41 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9" returned: 0 in 0.626s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:41 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9 Nov 03 18:34:41 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:41 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6793aabe-785e-43fe-8e9d-dec88a0564ea" returned: 0 in 0.328s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-6793aabe-785e-43fe-8e9d-dec88a0564ea" released by "delete_volume" :: held 0.868s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:41 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ae3b9cee-83a1-4513-bcb2-5611e49847c9" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-quobyte-ae3b9cee-83a1-4513-bcb2-5611e49847c9" released by "delete_volume" :: held 1.022s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:41 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created reservations ['d5b23b4b-d257-4814-893f-c078f3d25d0f', '4ab7dcca-8801-4c3e-aee7-d319388da812', '08d34b3b-acd6-4008-99d0-0c9ab05b118b', 'c0faeda2-f480-45b6-bb27-35cfea60b769'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Created reservations ['baabde5e-996f-4ea5-84f1-96564013274c', '8fa809d5-3181-4459-b1ce-43d9258e06a9', '7fc50833-eff9-4661-9fab-290ff79b80d8', 'a3069703-bf4c-41b8-a173-a1cf43198f55'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:42 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:42 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-17cfbc4c-5f03-4e7c-aef2-499121585c78-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-17cfbc4c-5f03-4e7c-aef2-499121585c78-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:42 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:42 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-quobyte-17cfbc4c-5f03-4e7c-aef2-499121585c78" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-17cfbc4c-5f03-4e7c-aef2-499121585c78" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6323ffd6-c2aa-4c2f-8c9d-a1640bdd5fd2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:42 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 Nov 03 18:34:42 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:42 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.484s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Deleted volume successfully. Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8e8441a-94b5-4290-83d0-510c8a808a91 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-6793aabe-785e-43fe-8e9d-dec88a0564ea-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:42 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.456s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Deleted volume successfully. Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-52b4ce1a-7530-4865-8a8a-381b3fcfb181 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-ae3b9cee-83a1-4513-bcb2-5611e49847c9-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:42 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78" returned: 0 in 0.546s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:42 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78 Nov 03 18:34:42 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:43 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "cinder-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-17cfbc4c-5f03-4e7c-aef2-499121585c78" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-17cfbc4c-5f03-4e7c-aef2-499121585c78" released by "delete_volume" :: held 0.959s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "cinder-quobyte-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-quobyte-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created reservations ['948f6ed5-b1fa-4d68-885b-3d10148283fc', '2e486837-9ba2-46e4-b073-1ad7fe2490a6', 'efa3c573-44a0-4f35-8be6-bddd46dc8a77', '698107c6-7a5f-43c8-86d6-ebac97b70c1f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a8333e-fbb4-4c32-8f81-f22d72615520]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:43 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b Nov 03 18:34:43 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:43 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:43 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:43 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.333s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:43 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Deleted volume successfully. Nov 03 18:34:43 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b" returned: 0 in 0.526s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8fee5d9c-565b-4879-8401-780a09317bb8 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-17cfbc4c-5f03-4e7c-aef2-499121585c78-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:43 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b Nov 03 18:34:43 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:44 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b" returned: 0 in 0.314s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-quobyte-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b" released by "delete_volume" :: held 0.900s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Created reservations ['5f667584-90b3-428a-abf3-21e3ecb83f5b', '924152e0-c3e4-45c5-82e3-959f7407e483', '90517d3f-f79b-4d97-aeb2-3852ca7fa005', '96edec97-a80b-4d96-a7d4-e6ce65ecf449'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:44 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:44 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-1aa3aafb-732f-43fe-b179-d4ea9c20f91b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-1aa3aafb-732f-43fe-b179-d4ea9c20f91b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-quobyte-1aa3aafb-732f-43fe-b179-d4ea9c20f91b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-1aa3aafb-732f-43fe-b179-d4ea9c20f91b" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a762a0-6049-4c24-a81c-d7b1ce6e3ce7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:44 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.440s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Deleted volume successfully. Nov 03 18:34:44 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b Nov 03 18:34:44 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dc80eb24-8d45-4a55-a413-851509651841 tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-d52d5943-cb6f-4e59-9ca7-9874d19d5a1b-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:45 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b" returned: 0 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:45 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b Nov 03 18:34:45 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:45 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1aa3aafb-732f-43fe-b179-d4ea9c20f91b" returned: 0 in 0.343s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-1aa3aafb-732f-43fe-b179-d4ea9c20f91b" released by "delete_volume" :: held 0.835s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created reservations ['0e2458d8-f39e-49a1-943a-6f8b85b74560', 'f55b6e5f-fbf1-4ba4-a6f9-dc19045558d9', 'a2745a5b-15e0-4000-b3c0-2dd82f5652b8', '8de52095-9e3b-4cd1-a367-74bb6def6bbe'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "cinder-b13dd274-2b19-4e9e-9197-4878ff01c691-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-b13dd274-2b19-4e9e-9197-4878ff01c691-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "cinder-quobyte-b13dd274-2b19-4e9e-9197-4878ff01c691" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-quobyte-b13dd274-2b19-4e9e-9197-4878ff01c691" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:45 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:45 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df3b12c-9795-452a-80fa-2511d24100db]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:46 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 Nov 03 18:34:46 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:46 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.379s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Deleted volume successfully. Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3cfc6bcc-37da-484b-9915-4843d13d8151 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-1aa3aafb-732f-43fe-b179-d4ea9c20f91b-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:46 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691" returned: 0 in 0.539s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:46 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691 Nov 03 18:34:46 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:46 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b13dd274-2b19-4e9e-9197-4878ff01c691" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-quobyte-b13dd274-2b19-4e9e-9197-4878ff01c691" released by "delete_volume" :: held 0.977s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Created reservations ['d087013a-5915-4a1e-9a8f-c9440e2705bb', '4f411d03-03de-4d1b-a432-36c88682d843', 'be6c2103-c53f-407d-91fc-1e6aba28f589', '66a336ab-b69c-45da-b104-2d7cd68aa1ec'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-75ca97bd-8ee1-474c-9255-6f4a1915f1f9-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:47 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:47 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-75ca97bd-8ee1-474c-9255-6f4a1915f1f9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-quobyte-75ca97bd-8ee1-474c-9255-6f4a1915f1f9" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-75ca97bd-8ee1-474c-9255-6f4a1915f1f9" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[652c1f87-fead-4892-a082-71c69198d0a2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Flow 'volume_create_manager' (9a483f2c-fbaf-4d0c-b36e-36b931311fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529e500d-a671-47d9-b426-56caa36bf3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529e500d-a671-47d9-b426-56caa36bf3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1544998680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbf5e5e-4790-4841-9706-c5bac29e62af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1f01fce81c46eba7707a76b40a26c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:47Z,use_quota=True,user_id='6126e81630ba4f9e9f2334de965bcd98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802f4ba6-785e-48df-a00f-72cb084ffbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802f4ba6-785e-48df-a00f-72cb084ffbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d79379-8ea2-4cb3-b8cd-aa344cd6dc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d79379-8ea2-4cb3-b8cd-aa344cd6dc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbf5e5e-4790-4841-9706-c5bac29e62af', 'volume_name': 'volume-3fbf5e5e-4790-4841-9706-c5bac29e62af', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:47 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4516801-884a-4738-9568-9c35cf6538ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4516801-884a-4738-9568-9c35cf6538ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2f6069-4c57-4d04-baf1-1d27c499a236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Volume 3fbf5e5e-4790-4841-9706-c5bac29e62af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbf5e5e-4790-4841-9706-c5bac29e62af', 'volume_size': 1} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1544998680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbf5e5e-4790-4841-9706-c5bac29e62af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1f01fce81c46eba7707a76b40a26c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:47Z,use_quota=True,user_id='6126e81630ba4f9e9f2334de965bcd98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Creating volume 3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:47 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 Nov 03 18:34:47 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:47 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.373s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Deleted volume successfully. Nov 03 18:34:47 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af 1073741824 Nov 03 18:34:47 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bcd6a169-8a56-4272-a2e0-37a3f68de44d tempest-VolumesListTestJSON-1341439429 None] Lock "cinder-b13dd274-2b19-4e9e-9197-4878ff01c691-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:47 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9" returned: 0 in 0.465s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:47 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9 Nov 03 18:34:47 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:47 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af 1073741824" returned: 0 in 0.511s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:47 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af Nov 03 18:34:47 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:47 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-75ca97bd-8ee1-474c-9255-6f4a1915f1f9" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-75ca97bd-8ee1-474c-9255-6f4a1915f1f9" released by "delete_volume" :: held 0.835s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created reservations ['d3f59054-2fcb-4602-be0f-72d9a2471678', '8d6b3f90-9f28-4f47-b245-63453adae167', '63b36ada-6adf-4407-bffd-e67408601189', '39f42201-c89a-41d9-a931-4161650a4109'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:48 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:48 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:48 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af" returned: 0 in 0.373s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2f6069-4c57-4d04-baf1-1d27c499a236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbf5e5e-4790-4841-9706-c5bac29e62af', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9eaca2-b400-4c3b-9009-ec700a829ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-b21f8e37-00db-4f40-8e4b-63f061ffd9f0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:48 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Volume volume-3fbf5e5e-4790-4841-9706-c5bac29e62af (3fbf5e5e-4790-4841-9706-c5bac29e62af): created successfully Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f9eaca2-b400-4c3b-9009-ec700a829ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Flow 'volume_create_manager' (9a483f2c-fbaf-4d0c-b36e-36b931311fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0bd489b6-c1c6-4fea-9da3-2776eb4187b3 tempest-SnapshotDependencyTests-1636793668 None] Created volume successfully. Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-b21f8e37-00db-4f40-8e4b-63f061ffd9f0-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "cinder-quobyte-b21f8e37-00db-4f40-8e4b-63f061ffd9f0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-b21f8e37-00db-4f40-8e4b-63f061ffd9f0" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11f775-49c5-40e4-bbd7-9a2539c5f096]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:48 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.357s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Deleted volume successfully. Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c83291ca-026b-4445-8d21-ed6eaa311a9e tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-75ca97bd-8ee1-474c-9255-6f4a1915f1f9-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:48 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 Nov 03 18:34:48 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:48 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0" returned: 0 in 0.421s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:48 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0 Nov 03 18:34:48 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:49 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b21f8e37-00db-4f40-8e4b-63f061ffd9f0" returned: 0 in 0.253s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-quobyte-b21f8e37-00db-4f40-8e4b-63f061ffd9f0" released by "delete_volume" :: held 0.747s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Created reservations ['67a747fc-b75d-4ccd-99b0-5417e5f005b0', '93778e78-2df5-4b99-a440-f7967f2bd460', '751601f5-dbbf-4145-8699-57e3ba5063a7', '860253d8-8d33-40b9-a9a8-b174d5b080aa'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:49 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:49 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Creating offline snapshot f6dd361a-5ea8-4310-b100-04461ca1d621 of volume 3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae488bb-0557-4b0d-84c9-913bf476c904]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:49 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.416s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:34:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Deleted volume successfully. Nov 03 18:34:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cb1be1c6-2a61-4a60-9b3f-a47d1cc6b000 tempest-CreateVolumesFromSourceVolumeTest-1199627099 None] Lock "cinder-b21f8e37-00db-4f40-8e4b-63f061ffd9f0-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:34:49 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af Nov 03 18:34:49 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:50 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af" returned: 0 in 0.473s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:50 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 1G Nov 03 18:34:50 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:50 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 1G" returned: 0 in 0.564s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbf5e5e-4790-4841-9706-c5bac29e62af -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:50 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbf5e5e-4790-4841-9706-c5bac29e62af -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 Nov 03 18:34:50 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:51 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fbf5e5e-4790-4841-9706-c5bac29e62af -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621" returned: 0 in 0.409s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:51 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 is being set with open permissions: ugo+rw Nov 03 18:34:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:51 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 Nov 03 18:34:51 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:51 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621" returned: 0 in 0.287s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:51 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info Nov 03 18:34:51 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:51 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:51 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info is being set with open permissions: ugo+rw Nov 03 18:34:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:51 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info Nov 03 18:34:51 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:52 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.info" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-59804c21-0502-4325-a86d-a26ce94527f4 tempest-SnapshotDependencyTests-1636793668 None] Create snapshot completed successfully Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Flow 'volume_create_manager' (5a53e0e2-88a2-4f17-a0aa-fe8980093401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb428b6-ce4e-429a-a54a-de32f6c259a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb428b6-ce4e-429a-a54a-de32f6c259a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-874010506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c52e2a254e0c42ea96f92422016973ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:53Z,use_quota=True,user_id='72e72c374e8343dba97a92bb352cddf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedfb921-34cb-4ad8-b2bf-f8cd76d5bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedfb921-34cb-4ad8-b2bf-f8cd76d5bf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a4e014-e524-42fd-aa78-51a541ff3ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a4e014-e524-42fd-aa78-51a541ff3ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249', 'volume_name': 'volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6532c81d-8338-4765-be94-329dd7040fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6532c81d-8338-4765-be94-329dd7040fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5fff18-ff3f-4a9c-8623-ac6e6d579442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Volume bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249', 'volume_size': 1} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-874010506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c52e2a254e0c42ea96f92422016973ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:53Z,use_quota=True,user_id='72e72c374e8343dba97a92bb352cddf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Creating volume bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:53 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:53 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 1073741824 Nov 03 18:34:53 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Flow 'volume_create_manager' (e55ef234-fa6a-4543-9f5e-d18e820287d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf3066-bebc-4ecb-a4d0-ed935a3da0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbf3066-bebc-4ecb-a4d0-ed935a3da0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7b5805-59a5-4c58-a01d-fd0fb7373d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1f01fce81c46eba7707a76b40a26c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6dd361a-5ea8-4310-b100-04461ca1d621,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:54Z,use_quota=True,user_id='6126e81630ba4f9e9f2334de965bcd98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251eb8a7-3823-46c6-9796-882477325ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (251eb8a7-3823-46c6-9796-882477325ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40fc41b-9734-4e7e-9e33-6462e19d9161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40fc41b-9734-4e7e-9e33-6462e19d9161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff7b5805-59a5-4c58-a01d-fd0fb7373d28', 'volume_name': 'volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28', 'volume_size': 1, 'snapshot_id': 'f6dd361a-5ea8-4310-b100-04461ca1d621'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6a4b8-f784-41d8-aa50-f7042c91084f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b6a4b8-f784-41d8-aa50-f7042c91084f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddf4dc8-f1cd-49a9-bb1d-e3cbe747f92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Volume ff7b5805-59a5-4c58-a01d-fd0fb7373d28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28', 'volume_size': 1, 'snapshot_id': 'f6dd361a-5ea8-4310-b100-04461ca1d621'} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:53 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 1073741824" returned: 0 in 0.482s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:53 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 Nov 03 18:34:53 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:54 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249" returned: 0 in 0.262s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.341s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-quobyte-f6dd361a-5ea8-4310-b100-04461ca1d621-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5fff18-ff3f-4a9c-8623-ac6e6d579442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e21c7e-f2bc-402f-9dbd-f5e0f6b5d8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-f6dd361a-5ea8-4310-b100-04461ca1d621-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Creating volume ff7b5805-59a5-4c58-a01d-fd0fb7373d28 from snapshot f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-quobyte-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:34:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Volume volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 (bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249): created successfully Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e21c7e-f2bc-402f-9dbd-f5e0f6b5d8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Flow 'volume_create_manager' (5a53e0e2-88a2-4f17-a0aa-fe8980093401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] snapshot: f6dd361a-5ea8-4310-b100-04461ca1d621, volume: ff7b5805-59a5-4c58-a01d-fd0fb7373d28, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:34:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9223d16f-252f-414c-b40d-776520041912 tempest-VolumesNegativeTest-130162411 None] Created volume successfully. Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f3cafa-0ae3-478b-a070-34cb84d91165]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:54 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 Nov 03 18:34:54 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:54 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fbf5e5e-4790-4841-9706-c5bac29e62af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9de390-da67-469b-8efb-0d292d5edb6d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:54 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af Nov 03 18:34:54 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:55 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af" returned: 0 in 0.455s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:34:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:34:55 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:34:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:55 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 Nov 03 18:34:55 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:56 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Flow 'volume_create_manager' (e3114f59-8cea-40da-9a86-21c4a1dfc4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be463c9d-9278-4df0-8258-6676c41d62e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be463c9d-9278-4df0-8258-6676c41d62e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8a71e5-abd4-4c66-846d-881070d7624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1949c0df63234c86ae37f86cf18ba96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:57Z,use_quota=True,user_id='aa9d939cd3194921a50371a25e462fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59251698-bddd-436a-b6ee-201c55a49589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59251698-bddd-436a-b6ee-201c55a49589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf189a0e-6de6-44e2-9591-75509d17d1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf189a0e-6de6-44e2-9591-75509d17d1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac8a71e5-abd4-4c66-846d-881070d7624c', 'volume_name': 'volume-ac8a71e5-abd4-4c66-846d-881070d7624c', 'volume_size': 1, 'image_id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b6fc77aaf057f89b889e7253d18f0e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1949c0df63234c86ae37f86cf18ba96f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a87e50e9eb13171ec20d6dd3c16db58682f6d5fa691fb37fb0f5abce944af482e6a7c40fab779d5764c34fe568eb9c31bf329cbf0d9fdc41a750924fdb31010d', 'id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'created_at': datetime.datetime(2026, 11, 3, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 34, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec/file', 'properties': {}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d9b383-1dd5-4cdb-9f74-5b0b5514d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d9b383-1dd5-4cdb-9f74-5b0b5514d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:34:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f83f99-aa14-4b7b-ad9e-0f856efe9f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:34:58 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Volume ac8a71e5-abd4-4c66-846d-881070d7624c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac8a71e5-abd4-4c66-846d-881070d7624c', 'volume_size': 1, 'image_id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b6fc77aaf057f89b889e7253d18f0e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1949c0df63234c86ae37f86cf18ba96f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a87e50e9eb13171ec20d6dd3c16db58682f6d5fa691fb37fb0f5abce944af482e6a7c40fab779d5764c34fe568eb9c31bf329cbf0d9fdc41a750924fdb31010d', 'id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'created_at': datetime.datetime(2026, 11, 3, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 34, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec/file', 'properties': {}}, 'image_service': } Nov 03 18:34:58 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Trying to clone ac8a71e5-abd4-4c66-846d-881070d7624c from image 22e7deff-22d6-4a6c-be47-59bf4829c2ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:34:58 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:34:58 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Image download 0.00 MB at 0.00 MB/s Nov 03 18:34:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[781608af-e25a-4f73-8b6d-9415210935bc]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:34:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:58 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD Nov 03 18:34:58 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:59 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:59 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD Nov 03 18:34:59 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:34:59 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:34:59 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:34:59 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD" returned: 1 in 0.778s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:34:59 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Temporary image 22e7deff-22d6-4a6c-be47-59bf4829c2ec is fetched for user aa9d939cd3194921a50371a25e462fa3. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453aec9-9937-4bf3-a0d2-339f2c6312c1]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:00 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.727s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:35:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:35:00 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD Nov 03 18:35:00 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:01 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:01 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD Nov 03 18:35:01 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:01 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD" returned: 1 in 0.754s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:35:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:05 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" returned: 0 in 9.976s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af, size 1024.00 MB, duration 9.98 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:35:05 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Converted 1024.00 MB image at 102.63 MB/s Nov 03 18:35:05 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 is being set with open permissions: ugo+rw Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:05 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 Nov 03 18:35:05 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:05 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" released by "_copy_volume_from_snapshot" :: held 11.315s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-f6dd361a-5ea8-4310-b100-04461ca1d621-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" released by "_create_volume_from_snapshot" :: held 11.427s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.459s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.812s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8a71e5-abd4-4c66-846d-881070d7624c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1949c0df63234c86ae37f86cf18ba96f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:34:57Z,use_quota=True,user_id='aa9d939cd3194921a50371a25e462fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Creating volume ac8a71e5-abd4-4c66-846d-881070d7624c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:05 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:05 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c 1073741824 Nov 03 18:35:05 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bddf4dc8-f1cd-49a9-bb1d-e3cbe747f92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28', 'volume_size': 1, 'snapshot_id': 'f6dd361a-5ea8-4310-b100-04461ca1d621'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb64369-9ca7-44f1-b9a4-86e90a0cc0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Volume volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 (ff7b5805-59a5-4c58-a01d-fd0fb7373d28): created successfully Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb64369-9ca7-44f1-b9a4-86e90a0cc0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Flow 'volume_create_manager' (e55ef234-fa6a-4543-9f5e-d18e820287d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7138ecac-5864-4a94-896d-2739927bf2df tempest-SnapshotDependencyTests-1636793668 None] Created volume successfully. Nov 03 18:35:06 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c 1073741824" returned: 0 in 0.714s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:06 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c Nov 03 18:35:06 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-f6dd361a-5ea8-4310-b100-04461ca1d621-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-f6dd361a-5ea8-4310-b100-04461ca1d621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-quobyte-3fbf5e5e-4790-4841-9706-c5bac29e62af" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-3fbf5e5e-4790-4841-9706-c5bac29e62af" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-quobyte-f6dd361a-5ea8-4310-b100-04461ca1d621" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-f6dd361a-5ea8-4310-b100-04461ca1d621" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Deleting offline snapshot f6dd361a-5ea8-4310-b100-04461ca1d621 of volume 3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] snapshot_file for this snap is: volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c9e9f-67eb-444c-a34f-7d3ce617d544]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:07 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c" returned: 0 in 0.623s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Attempting download of 22e7deff-22d6-4a6c-be47-59bf4829c2ec ((None, [{'url': 'file:///opt/stack/data/glance/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'metadata': {}}])) to volume ac8a71e5-abd4-4c66-846d-881070d7624c. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:35:07 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 Nov 03 18:35:07 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[55340b2c-6585-4929-88f8-c094fbc5420f]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:07 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1 Nov 03 18:35:07 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:07 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621" returned: 0 in 0.899s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fbf5e5e-4790-4841-9706-c5bac29e62af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e48ba-0f89-4c31-b733-e8bbb6b5d2d9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:07 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1" returned: 0 in 0.684s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:08 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af Nov 03 18:35:08 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:08 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1 Nov 03 18:35:08 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:08 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1" returned: 1 in 0.635s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e7deff-22d6-4a6c-be47-59bf4829c2ec_ivbsrpn1' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:35:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[266f42af-d066-4b3a-bf54-3079923ce867]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:08 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af" returned: 0 in 0.849s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:08 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD Nov 03 18:35:08 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:08 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 Nov 03 18:35:08 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:09 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:09 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD Nov 03 18:35:09 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:09 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621" returned: 0 in 0.501s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:09 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621 Nov 03 18:35:09 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:09 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] 22e7deff-22d6-4a6c-be47-59bf4829c2ec was raw, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:09 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c Nov 03 18:35:09 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:09 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af.f6dd361a-5ea8-4310-b100-04461ca1d621" returned: 0 in 0.324s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-f6dd361a-5ea8-4310-b100-04461ca1d621" released by "_delete_snapshot" :: held 2.846s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-3fbf5e5e-4790-4841-9706-c5bac29e62af" released by "delete_snapshot" :: held 2.901s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Created reservations ['e15385ba-82f9-4a77-a617-389b4625effa', 'c07232c4-f219-47ec-97ce-567eac848527', 'a6c2e95a-527a-41dc-b669-02baecdcec43', 'aab6cc0f-ead5-4381-8249-cf63eabae7ca'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Delete snapshot completed successfully. Nov 03 18:35:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f7aee224-1709-42bb-bfbe-9d8b2cc131e4 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-f6dd361a-5ea8-4310-b100-04461ca1d621-delete_snapshot" released by "delete_snapshot" :: held 3.188s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-3fbf5e5e-4790-4841-9706-c5bac29e62af-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-3fbf5e5e-4790-4841-9706-c5bac29e62af-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-quobyte-3fbf5e5e-4790-4841-9706-c5bac29e62af" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-3fbf5e5e-4790-4841-9706-c5bac29e62af" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe22bb-3ef0-43f5-93cc-d5000a148bd2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:10 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c" returned: 0 in 0.919s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22e7deff-22d6-4a6c-be47-59bf4829c2ec_8x0p6gkodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:35:10 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:10 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c 1G Nov 03 18:35:10 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af Nov 03 18:35:10 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:10 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Flow 'volume_create_manager' (26f7ce64-c821-47e7-b8e3-d94279296516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339793ea-572e-49cf-9659-f9616a4cc890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339793ea-572e-49cf-9659-f9616a4cc890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-461948409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5308f443-6433-426a-9ec3-4a7503d31ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dc60281df54f7ea4f108c472ac1f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:11Z,use_quota=True,user_id='6f97e4a4d7cc49ab99b307113def6420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bf11f18-8469-4930-9b2c-fb2f27a181cd),volume_type_id=1bf11f18-8469-4930-9b2c-fb2f27a181cd)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff6a3d3-d161-424b-baf6-a932f1ad5bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff6a3d3-d161-424b-baf6-a932f1ad5bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cc7748-996b-4832-9bbf-0500f02fbb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cc7748-996b-4832-9bbf-0500f02fbb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5308f443-6433-426a-9ec3-4a7503d31ef4', 'volume_name': 'volume-5308f443-6433-426a-9ec3-4a7503d31ef4', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de149684-a334-4eba-b245-faef6020c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de149684-a334-4eba-b245-faef6020c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007dbc3f-81f5-4abd-8508-5ed3f7ff1982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Volume 5308f443-6433-426a-9ec3-4a7503d31ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5308f443-6433-426a-9ec3-4a7503d31ef4', 'volume_size': 1} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-461948409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5308f443-6433-426a-9ec3-4a7503d31ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51dc60281df54f7ea4f108c472ac1f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:11Z,use_quota=True,user_id='6f97e4a4d7cc49ab99b307113def6420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1bf11f18-8469-4930-9b2c-fb2f27a181cd),volume_type_id=1bf11f18-8469-4930-9b2c-fb2f27a181cd)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Creating volume 5308f443-6433-426a-9ec3-4a7503d31ef4 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:10 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:10 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af" returned: 0 in 0.795s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:11 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 1073741824 Nov 03 18:35:11 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:11 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af Nov 03 18:35:11 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:11 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c 1G" returned: 0 in 0.644s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Downloaded image 22e7deff-22d6-4a6c-be47-59bf4829c2ec ((None, [{'url': 'file:///opt/stack/data/glance/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'metadata': {}}])) to volume ac8a71e5-abd4-4c66-846d-881070d7624c successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Temporary image 22e7deff-22d6-4a6c-be47-59bf4829c2ec for user aa9d939cd3194921a50371a25e462fa3 is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Marking volume ac8a71e5-abd4-4c66-846d-881070d7624c as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Copying metadata from image 22e7deff-22d6-4a6c-be47-59bf4829c2ec to ac8a71e5-abd4-4c66-846d-881070d7624c. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Creating volume glance metadata for volume ac8a71e5-abd4-4c66-846d-881070d7624c backed by image 22e7deff-22d6-4a6c-be47-59bf4829c2ec with: {'image_id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1b6fc77aaf057f89b889e7253d18f0e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f83f99-aa14-4b7b-ad9e-0f856efe9f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8a71e5-abd4-4c66-846d-881070d7624c', 'volume_size': 1, 'image_id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b6fc77aaf057f89b889e7253d18f0e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1949c0df63234c86ae37f86cf18ba96f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a87e50e9eb13171ec20d6dd3c16db58682f6d5fa691fb37fb0f5abce944af482e6a7c40fab779d5764c34fe568eb9c31bf329cbf0d9fdc41a750924fdb31010d', 'id': '22e7deff-22d6-4a6c-be47-59bf4829c2ec', 'created_at': datetime.datetime(2026, 11, 3, 17, 34, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 34, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e7deff-22d6-4a6c-be47-59bf4829c2ec/file', 'properties': {}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70291f50-ae95-4654-9697-a35e0235ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Volume volume-ac8a71e5-abd4-4c66-846d-881070d7624c (ac8a71e5-abd4-4c66-846d-881070d7624c): created successfully Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70291f50-ae95-4654-9697-a35e0235ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Flow 'volume_create_manager' (e3114f59-8cea-40da-9a86-21c4a1dfc4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-aabdf685-bc15-41d5-ade8-5cb07bc0b298 tempest-VolumeImageDependencyTests-1688190048 None] Created volume successfully. Nov 03 18:35:11 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3fbf5e5e-4790-4841-9706-c5bac29e62af" returned: 0 in 0.467s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-3fbf5e5e-4790-4841-9706-c5bac29e62af" released by "delete_volume" :: held 1.380s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Created reservations ['75ce02a3-e96c-4552-afca-3f8e744ba487', '3012b1e0-2f28-4a53-aeb9-80fc7ef2078f', 'cae37a36-7cc8-4058-8d6f-cc6c2622e516', 'c3d5c009-afc0-40d5-b9ca-c058fd3e070c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:11 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 1073741824" returned: 0 in 0.731s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:11 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:11 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:11 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 Nov 03 18:35:11 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:12 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.315s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Deleted volume successfully. Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d469a79f-6302-42f9-bbea-bbaf4bf95c11 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-3fbf5e5e-4790-4841-9706-c5bac29e62af-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:12 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4" returned: 0 in 0.321s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007dbc3f-81f5-4abd-8508-5ed3f7ff1982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5308f443-6433-426a-9ec3-4a7503d31ef4', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a23806-9fd0-4b6d-84f0-e486ae17293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Volume volume-5308f443-6433-426a-9ec3-4a7503d31ef4 (5308f443-6433-426a-9ec3-4a7503d31ef4): created successfully Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a23806-9fd0-4b6d-84f0-e486ae17293b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Flow 'volume_create_manager' (26f7ce64-c821-47e7-b8e3-d94279296516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fa4ca5ad-3bf6-4124-aa06-9a2d2305f3f5 tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Created volume successfully. Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Acquiring lock "cinder-ac8a71e5-abd4-4c66-846d-881070d7624c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-ff7b5805-59a5-4c58-a01d-fd0fb7373d28-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Lock "cinder-ac8a71e5-abd4-4c66-846d-881070d7624c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-ff7b5805-59a5-4c58-a01d-fd0fb7373d28-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Acquiring lock "cinder-quobyte-ac8a71e5-abd4-4c66-846d-881070d7624c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Lock "cinder-quobyte-ac8a71e5-abd4-4c66-846d-881070d7624c" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "cinder-quobyte-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c4de1-78a5-4d8a-948f-55fa5f9aae21]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9967f864-351f-4ebc-b9ad-059b5aad1a17]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:12 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c Nov 03 18:35:12 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:12 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 Nov 03 18:35:12 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:13 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" returned: 0 in 0.413s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:13 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c" returned: 0 in 0.465s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:13 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28 Nov 03 18:35:13 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:13 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c Nov 03 18:35:13 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:13 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:13 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:13 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac8a71e5-abd4-4c66-846d-881070d7624c" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:13 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" returned: 0 in 0.324s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Lock "cinder-quobyte-ac8a71e5-abd4-4c66-846d-881070d7624c" released by "delete_volume" :: held 0.843s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-quobyte-ff7b5805-59a5-4c58-a01d-fd0fb7373d28" released by "delete_volume" :: held 0.824s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Created reservations ['da5f0447-72cf-4a41-b200-7e0024209629', '1f1ce0c4-747c-4d7f-b56c-46892b7fa074', '81f3f87f-23ea-4b52-9e1b-959981ebe2d2', 'a44bdaa0-5ef5-41e0-965c-9a2637ca4967'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Created reservations ['2566d140-71ec-473c-8e29-812c419855c5', 'e78ecd55-7def-4a72-a1d3-b71d586308c1', '68db4bf8-7452-42ee-8e6d-f92fe1dfc13c', '97659640-2982-4e11-b092-0a883119119d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:13 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-69d7fec1-9401-4a0f-b70a-fd16e3ba857a tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Retype volume completed successfully. Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:13 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:13 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:13 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:13 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:13 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.282s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Deleted volume successfully. Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b80de53b-7e80-4692-8617-068833a971b9 tempest-SnapshotDependencyTests-1636793668 None] Lock "cinder-ff7b5805-59a5-4c58-a01d-fd0fb7373d28-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:14 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.317s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Deleted volume successfully. Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f76e9604-7c00-4ad5-93e8-9bb7d49d52f9 tempest-VolumeImageDependencyTests-1688190048 None] Lock "cinder-ac8a71e5-abd4-4c66-846d-881070d7624c-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Acquiring lock "cinder-5308f443-6433-426a-9ec3-4a7503d31ef4-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "cinder-5308f443-6433-426a-9ec3-4a7503d31ef4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Acquiring lock "cinder-quobyte-5308f443-6433-426a-9ec3-4a7503d31ef4" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "cinder-quobyte-5308f443-6433-426a-9ec3-4a7503d31ef4" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160e948-c169-450b-a94e-b71e9a6c1a15]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:14 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 Nov 03 18:35:14 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:15 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4" returned: 0 in 0.500s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:15 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4 Nov 03 18:35:15 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:15 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5308f443-6433-426a-9ec3-4a7503d31ef4" returned: 0 in 0.335s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "cinder-quobyte-5308f443-6433-426a-9ec3-4a7503d31ef4" released by "delete_volume" :: held 0.893s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:15 devstack cinder-volume[86841]: WARNING cinder.quota [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:35:15 devstack cinder-volume[86841]: WARNING cinder.quota [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Created reservations ['204f7d96-66ef-4288-b79f-d09408906a2e', '0060cad0-67f6-4b00-aabe-b30451f46915', '9776bdee-87ca-4221-be3b-716e0c01f487', 'cc1e22c1-0475-4d3d-a7c3-1d398458567e'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:15 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:15 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:16 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.411s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:16 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Deleted volume successfully. Nov 03 18:35:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f5c022bb-626c-4c6d-83de-744cbb3dffef tempest-VolumeRetypeWithoutMigrationTest-2000522208 None] Lock "cinder-5308f443-6433-426a-9ec3-4a7503d31ef4-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Acquiring lock "cinder-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Lock "cinder-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Acquiring lock "cinder-quobyte-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Lock "cinder-quobyte-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c72aec7-088b-47e6-835c-66093d3fe1f8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:22 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 Nov 03 18:35:22 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:22 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249" returned: 0 in 0.478s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:22 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249 Nov 03 18:35:22 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:23 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249" returned: 0 in 0.407s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Lock "cinder-quobyte-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249" released by "delete_volume" :: held 0.952s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Created reservations ['9e37fbcc-778f-4c8e-99a2-893526937222', 'f90123a6-4699-4506-8503-f15099fdca8c', 'c6bcc6b3-2958-4acf-906b-8bee412ba247', '2974f3d8-6cf6-4bba-b4db-d2c2f16c07b8'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:23 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:23 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:23 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Deleted volume successfully. Nov 03 18:35:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9cd82b6a-a704-48ec-8c1b-dd764932b7c0 tempest-VolumesNegativeTest-130162411 None] Lock "cinder-bc7ecd9b-ea8e-4cfc-bc67-6c0567fba249-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Flow 'volume_create_manager' (ae4b0c8a-e626-41fe-abd2-3985078a4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563bb709-4600-4af0-a95e-a78f7f4a6e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (563bb709-4600-4af0-a95e-a78f7f4a6e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1011627164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d6886c-17ff-4e13-975a-82d30b9bb2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e770ad23274f4b7aa9ad5064a2a7aab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:25Z,use_quota=True,user_id='b3c9371034e0411abeb79ed34a5b9054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544988f5-a807-4067-a0fd-ef3ef056c1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544988f5-a807-4067-a0fd-ef3ef056c1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64638ed0-1273-45dd-bb01-30ca684a0e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64638ed0-1273-45dd-bb01-30ca684a0e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d6886c-17ff-4e13-975a-82d30b9bb2b0', 'volume_name': 'volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682704a4-96d6-4106-ac6c-e0a681446b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (682704a4-96d6-4106-ac6c-e0a681446b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b3f0d5-3ae2-4c65-8744-944100342562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:25 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Volume c5d6886c-17ff-4e13-975a-82d30b9bb2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0', 'volume_size': 1} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1011627164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d6886c-17ff-4e13-975a-82d30b9bb2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e770ad23274f4b7aa9ad5064a2a7aab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:25Z,use_quota=True,user_id='b3c9371034e0411abeb79ed34a5b9054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Creating volume c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:25 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:25 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 1073741824 Nov 03 18:35:25 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:25 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 1073741824" returned: 0 in 0.590s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:25 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 Nov 03 18:35:25 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:26 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" returned: 0 in 0.292s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b3f0d5-3ae2-4c65-8744-944100342562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9873a8ba-f6e1-451c-b28f-f48ab35ac105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Volume volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 (c5d6886c-17ff-4e13-975a-82d30b9bb2b0): created successfully Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9873a8ba-f6e1-451c-b28f-f48ab35ac105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Flow 'volume_create_manager' (ae4b0c8a-e626-41fe-abd2-3985078a4161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-5e668f4d-0a91-4299-b81d-6bebbefd2a45 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Created volume successfully. Nov 03 18:35:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Creating offline snapshot a3410707-b144-4845-a68d-3010f7af11f5 of volume c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:35:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418fe45-38ad-4ade-8d39-9cae30c0a462]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:27 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 Nov 03 18:35:27 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:28 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" returned: 0 in 0.533s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:28 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 1G Nov 03 18:35:28 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:28 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 1G" returned: 0 in 0.600s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:28 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 Nov 03 18:35:28 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:29 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5" returned: 0 in 0.383s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:29 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 is being set with open permissions: ugo+rw Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:29 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 Nov 03 18:35:29 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Flow 'volume_create_manager' (93d17e2b-be52-420f-8b4c-64c33f9a4489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e70fd-29b7-4f26-a1e9-6465b3cf40fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296e70fd-29b7-4f26-a1e9-6465b3cf40fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-872065565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd1939e-4bb7-46c9-8fc8-2b08757708a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7aad4cf223249d3bcdb76d419b5d615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:29Z,use_quota=True,user_id='910b4856db8f4977929b12cb55ac3f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad42d794-fcd8-406b-950d-44e25bdab37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad42d794-fcd8-406b-950d-44e25bdab37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e93bed8-fe55-4b29-9a97-3b84aff53175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e93bed8-fe55-4b29-9a97-3b84aff53175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd1939e-4bb7-46c9-8fc8-2b08757708a6', 'volume_name': 'volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6', 'volume_size': 2}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcdeb7c-69ee-4a18-b0bf-983720cbabab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcdeb7c-69ee-4a18-b0bf-983720cbabab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1817dd2d-0276-4b7f-badc-9fbe51dd3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Volume 2bd1939e-4bb7-46c9-8fc8-2b08757708a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6', 'volume_size': 2} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:29 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5" returned: 0 in 0.294s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:29 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info Nov 03 18:35:29 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:29 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info" returned: 0 in 0.262s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:29 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info is being set with open permissions: ugo+rw Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:29 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info Nov 03 18:35:29 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:29 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.info" returned: 0 in 0.253s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-872065565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd1939e-4bb7-46c9-8fc8-2b08757708a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7aad4cf223249d3bcdb76d419b5d615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:29Z,use_quota=True,user_id='910b4856db8f4977929b12cb55ac3f09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Creating volume 2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:29 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 2147483648 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:29 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 2147483648 Nov 03 18:35:29 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-49741e34-9c72-4619-94bc-c063e79dd9b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Create snapshot completed successfully Nov 03 18:35:30 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 2147483648" returned: 0 in 0.539s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:30 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 Nov 03 18:35:30 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:30 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" returned: 0 in 0.280s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1817dd2d-0276-4b7f-badc-9fbe51dd3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6', 'volume_size': 2}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b196c564-31c1-4e3d-8f11-5b1f9bb0f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Volume volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 (2bd1939e-4bb7-46c9-8fc8-2b08757708a6): created successfully Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b196c564-31c1-4e3d-8f11-5b1f9bb0f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Flow 'volume_create_manager' (93d17e2b-be52-420f-8b4c-64c33f9a4489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8bd947e8-345a-4d67-9bd9-5efc94c70781 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Created volume successfully. Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "cinder-a3410707-b144-4845-a68d-3010f7af11f5-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-a3410707-b144-4845-a68d-3010f7af11f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "cinder-quobyte-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-quobyte-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "cinder-quobyte-a3410707-b144-4845-a68d-3010f7af11f5" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-quobyte-a3410707-b144-4845-a68d-3010f7af11f5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Deleting offline snapshot a3410707-b144-4845-a68d-3010f7af11f5 of volume c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] snapshot_file for this snap is: volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a200ad9-a292-4893-82a0-c84c42c2a4e0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:31 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 Nov 03 18:35:31 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Creating offline snapshot f934467d-c960-4e08-a642-3b5a58f027be of volume 2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d84db2-9132-4f28-8d27-a9dc1bbcd4ad]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:31 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5" returned: 0 in 0.453s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3144831-4d54-48ec-9ec5-094593d5decb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:31 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 Nov 03 18:35:31 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:31 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 Nov 03 18:35:31 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:31 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be 2G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:31 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be 2G Nov 03 18:35:31 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:32 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:32 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 Nov 03 18:35:32 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:32 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be 2G" returned: 0 in 0.410s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:32 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be Nov 03 18:35:32 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:32 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5" returned: 0 in 0.352s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:32 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5 Nov 03 18:35:32 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:32 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be" returned: 0 in 0.307s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:32 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be is being set with open permissions: ugo+rw Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:32 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0.a3410707-b144-4845-a68d-3010f7af11f5" returned: 0 in 0.277s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:32 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be Nov 03 18:35:32 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-quobyte-a3410707-b144-4845-a68d-3010f7af11f5" released by "_delete_snapshot" :: held 1.584s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-quobyte-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" released by "delete_snapshot" :: held 1.612s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Created reservations ['c67788d7-bbad-48ef-a193-d1bc7bb33890', 'a8f1a122-6c1f-4747-8030-30f46b8ebb55', '2beb7b2e-654a-4958-94f5-d7d01a98922c', '6f3e4aac-3cbc-4a2b-bd96-f110c967e123'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Delete snapshot completed successfully. Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1ea5e2df-fa3e-44e2-ae57-17432a42b067 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-a3410707-b144-4845-a68d-3010f7af11f5-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:32 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:32 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info Nov 03 18:35:32 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:33 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:33 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info is being set with open permissions: ugo+rw Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:33 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info Nov 03 18:35:33 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "cinder-c5d6886c-17ff-4e13-975a-82d30b9bb2b0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-c5d6886c-17ff-4e13-975a-82d30b9bb2b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "cinder-quobyte-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-quobyte-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b30bf3-e5bf-4dd3-964c-79611c4893c5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:33 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.info" returned: 0 in 0.255s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cd3ec24b-6c90-41a3-bcaf-839aa2fe278d tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Create snapshot completed successfully Nov 03 18:35:33 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 Nov 03 18:35:33 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "cinder-f934467d-c960-4e08-a642-3b5a58f027be-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-f934467d-c960-4e08-a642-3b5a58f027be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "cinder-quobyte-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-quobyte-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "cinder-quobyte-f934467d-c960-4e08-a642-3b5a58f027be" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-quobyte-f934467d-c960-4e08-a642-3b5a58f027be" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Deleting offline snapshot f934467d-c960-4e08-a642-3b5a58f027be of volume 2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] snapshot_file for this snap is: volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2fee00-26c6-4585-b065-f585fbfbb90d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:33 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" returned: 0 in 0.386s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:33 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0 Nov 03 18:35:33 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:33 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be Nov 03 18:35:33 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:34 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" returned: 0 in 0.250s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-quobyte-c5d6886c-17ff-4e13-975a-82d30b9bb2b0" released by "delete_volume" :: held 0.702s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Created reservations ['ed339a7d-0132-4e83-ae23-a491b2d78579', '8fa039e6-8b86-4382-9ba3-d667cf99f160', '1547f5fe-aff1-4538-87df-2596a931a959', 'dc22bc01-54e4-491e-af7e-80c2b9bbb9a7'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:34 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be" returned: 0 in 0.375s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd019b-ac78-47ff-a82d-9896dbd2ac17]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:34 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:34 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:34 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 Nov 03 18:35:34 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:34 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Deleted volume successfully. Nov 03 18:35:34 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2a654f1a-b99a-4d14-9686-5d7946e4cdd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-2127677909 None] Lock "cinder-c5d6886c-17ff-4e13-975a-82d30b9bb2b0-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:34 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be Nov 03 18:35:34 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:34 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be" returned: 0 in 0.359s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:34 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be Nov 03 18:35:34 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:35 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6.f934467d-c960-4e08-a642-3b5a58f027be" returned: 0 in 0.273s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-quobyte-f934467d-c960-4e08-a642-3b5a58f027be" released by "_delete_snapshot" :: held 1.505s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-quobyte-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" released by "delete_snapshot" :: held 1.530s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Created reservations ['fa63a157-d923-4325-9d22-d5090538d1cf', '26c6b350-3806-4dc1-a648-28d16f1a00d2', 'c5a120b9-8224-408b-bd2e-e4bf915ca7bc', '28e7b71c-23e9-45be-808e-4ba3284f9a6c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Delete snapshot completed successfully. Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b62f9638-4d1e-45f9-b306-b2cd37a9974c tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-f934467d-c960-4e08-a642-3b5a58f027be-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "cinder-2bd1939e-4bb7-46c9-8fc8-2b08757708a6-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-2bd1939e-4bb7-46c9-8fc8-2b08757708a6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "cinder-quobyte-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-quobyte-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4c7328-6915-4de4-8872-aff4836df8b7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:36 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 Nov 03 18:35:36 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:36 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" returned: 0 in 0.387s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:36 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6 Nov 03 18:35:36 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:36 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-quobyte-2bd1939e-4bb7-46c9-8fc8-2b08757708a6" released by "delete_volume" :: held 0.726s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=177,cinder:DELETE=14,cinder:SELECT=136,cinder:INSERT=44 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Created reservations ['a9ca7244-9eb3-4a1c-ab7b-56a1ca019e43', 'b7cba51f-f882-465e-85b0-d3dfb64cd02e', '7a3961e4-fbcf-4096-b3a0-0acfb075ddb9', 'df8c9545-89a3-4cd3-a9e5-b4abb67d2aa8'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:36 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:36 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:37 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:37 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Deleted volume successfully. Nov 03 18:35:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-537d3da3-7492-45d0-b5ed-8f31133db917 tempest-VolumesSnapshotNegativeTestJSON-671358616 None] Lock "cinder-2bd1939e-4bb7-46c9-8fc8-2b08757708a6-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=182,cinder:SELECT=137,cinder:INSERT=51,cinder:DELETE=14 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Flow 'volume_create_manager' (a673f93c-d215-4e62-91a3-12e7a857a905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd1c4b0-da8b-47f7-a465-6c11103132cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdd1c4b0-da8b-47f7-a465-6c11103132cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-591106674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b64b855-8a4e-47f8-9db0-1c1989e9d1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23950953aad548afa5d848b3a4cf5967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:41Z,use_quota=True,user_id='8dce8f6161b5413486e2724bd9f3f03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd34d89-b572-435c-9167-22e0bd08c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd34d89-b572-435c-9167-22e0bd08c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0717daaf-33f2-4ab8-a63f-560487057273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0717daaf-33f2-4ab8-a63f-560487057273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b64b855-8a4e-47f8-9db0-1c1989e9d1ef', 'volume_name': 'volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580e48cf-2917-454b-a5dc-d19e37548dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (580e48cf-2917-454b-a5dc-d19e37548dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7716b7dd-89bb-4894-8b34-973a06093022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Volume 2b64b855-8a4e-47f8-9db0-1c1989e9d1ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef', 'volume_size': 1} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-591106674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b64b855-8a4e-47f8-9db0-1c1989e9d1ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23950953aad548afa5d848b3a4cf5967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:41Z,use_quota=True,user_id='8dce8f6161b5413486e2724bd9f3f03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Creating volume 2b64b855-8a4e-47f8-9db0-1c1989e9d1ef {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:40 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:40 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef 1073741824 Nov 03 18:35:40 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:41 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef 1073741824" returned: 0 in 0.489s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:41 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef Nov 03 18:35:41 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:41 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7716b7dd-89bb-4894-8b34-973a06093022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fd6ba8-274d-4bf5-a90c-3e17d8959f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Volume volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef (2b64b855-8a4e-47f8-9db0-1c1989e9d1ef): created successfully Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fd6ba8-274d-4bf5-a90c-3e17d8959f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Flow 'volume_create_manager' (a673f93c-d215-4e62-91a3-12e7a857a905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-531373cd-fe8f-4853-b6f3-9768b0e39b40 tempest-VolumesTransfersV355Test-1506626695 None] Created volume successfully. Nov 03 18:35:43 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e7865834-0a39-440b-86f4-52b076a968db tempest-VolumesTransfersV355Test-23578483 None] Transfer volume completed successfully. Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Acquiring lock "cinder-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Acquiring lock "cinder-quobyte-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-quobyte-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f8b99-b4b5-4c11-9db7-b74d640e640f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:44 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef Nov 03 18:35:44 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:44 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef" returned: 0 in 0.390s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:44 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef Nov 03 18:35:44 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:44 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-quobyte-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef" released by "delete_volume" :: held 0.783s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Created reservations ['331a5979-0627-47ac-98f7-9d5938a85545', '7f8c7668-16a9-49a7-a039-25a4534f85a7', 'aa365cbf-cc30-4224-80d3-6641532445aa', '870613f3-3356-44cb-b794-ee79c0de34dc'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:45 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:45 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:45 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.287s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:45 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Deleted volume successfully. Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4ba3ed77-009b-4e6d-8629-2d8559f068ca tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-2b64b855-8a4e-47f8-9db0-1c1989e9d1ef-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Flow 'volume_create_manager' (6d8eda37-6317-4445-b7ea-9137e53850d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a17aac-9a26-4a91-b5ee-04111bb8dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a17aac-9a26-4a91-b5ee-04111bb8dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447240303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c89974-18b7-40c0-bc5c-7762d71d3333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23950953aad548afa5d848b3a4cf5967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:46Z,use_quota=True,user_id='8dce8f6161b5413486e2724bd9f3f03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cf13f0-9ba2-484c-8407-2fba14827fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66cf13f0-9ba2-484c-8407-2fba14827fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b49309-c1cc-4c2d-96e7-5080d5c1902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b49309-c1cc-4c2d-96e7-5080d5c1902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c89974-18b7-40c0-bc5c-7762d71d3333', 'volume_name': 'volume-66c89974-18b7-40c0-bc5c-7762d71d3333', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127b7b55-4cf0-49cc-9408-9736a7aa7461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127b7b55-4cf0-49cc-9408-9736a7aa7461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd08cd4e-c839-41ff-8915-545b93f6d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Volume 66c89974-18b7-40c0-bc5c-7762d71d3333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c89974-18b7-40c0-bc5c-7762d71d3333', 'volume_size': 1} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1447240303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c89974-18b7-40c0-bc5c-7762d71d3333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23950953aad548afa5d848b3a4cf5967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:46Z,use_quota=True,user_id='8dce8f6161b5413486e2724bd9f3f03a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Creating volume 66c89974-18b7-40c0-bc5c-7762d71d3333 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:45 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:45 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 1073741824 Nov 03 18:35:45 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:46 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 1073741824" returned: 0 in 0.477s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:46 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 Nov 03 18:35:46 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:46 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd08cd4e-c839-41ff-8915-545b93f6d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c89974-18b7-40c0-bc5c-7762d71d3333', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d89fc34-b6bb-4a25-8db0-3a3392fec78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:46 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Volume volume-66c89974-18b7-40c0-bc5c-7762d71d3333 (66c89974-18b7-40c0-bc5c-7762d71d3333): created successfully Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d89fc34-b6bb-4a25-8db0-3a3392fec78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Flow 'volume_create_manager' (6d8eda37-6317-4445-b7ea-9137e53850d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9db4b9f6-7337-46f0-8f41-88faf485cb64 tempest-VolumesTransfersV355Test-1506626695 None] Created volume successfully. Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Acquiring lock "cinder-66c89974-18b7-40c0-bc5c-7762d71d3333-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-66c89974-18b7-40c0-bc5c-7762d71d3333-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Acquiring lock "cinder-quobyte-66c89974-18b7-40c0-bc5c-7762d71d3333" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-quobyte-66c89974-18b7-40c0-bc5c-7762d71d3333" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb49e62f-0e62-46d8-b75e-f6fa8a6f5be2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:48 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 Nov 03 18:35:48 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:48 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333" returned: 0 in 0.388s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:48 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333 Nov 03 18:35:48 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:49 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66c89974-18b7-40c0-bc5c-7762d71d3333" returned: 0 in 0.279s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-quobyte-66c89974-18b7-40c0-bc5c-7762d71d3333" released by "delete_volume" :: held 0.718s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Created reservations ['9ee39268-f6ff-4cc9-bd49-6fcdb39e74ee', 'a2680d74-f830-4dea-b496-8817ffbe7176', '56c1e4c5-88bc-4e4e-a459-ad4fa0677ac6', '1d2566b2-39b6-42b6-934f-9cb2b408722f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:49 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:49 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:49 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.277s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Deleted volume successfully. Nov 03 18:35:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d199c5e0-ecdb-4e35-ae1b-ba400e8aada6 tempest-VolumesTransfersV355Test-777252603 None] Lock "cinder-66c89974-18b7-40c0-bc5c-7762d71d3333-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Flow 'volume_create_manager' (3b3bf630-0b87-4efb-a727-f750be94acf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b077e0f-52d8-45d3-aea0-cb7ec661d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b077e0f-52d8-45d3-aea0-cb7ec661d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-667957660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8975aa-c430-4ee4-8f64-cc248681eab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2220ce4c514e48a544f380db8268fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:56Z,use_quota=True,user_id='456d8e1a33e8426a9eebcb749d50ca88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88eb6c74-8258-4f28-8294-3bfa25430485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88eb6c74-8258-4f28-8294-3bfa25430485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921eb758-90d3-4479-801a-53f0e0a49906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921eb758-90d3-4479-801a-53f0e0a49906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8975aa-c430-4ee4-8f64-cc248681eab0', 'volume_name': 'volume-cc8975aa-c430-4ee4-8f64-cc248681eab0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cfc838-c385-4294-b383-a06de2effc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cfc838-c385-4294-b383-a06de2effc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337292a5-4a10-4b69-8f28-0ece3a7eb752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Volume cc8975aa-c430-4ee4-8f64-cc248681eab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8975aa-c430-4ee4-8f64-cc248681eab0', 'volume_size': 1} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-667957660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8975aa-c430-4ee4-8f64-cc248681eab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2220ce4c514e48a544f380db8268fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:56Z,use_quota=True,user_id='456d8e1a33e8426a9eebcb749d50ca88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Creating volume cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:35:56 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:56 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 1073741824 Nov 03 18:35:56 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:56 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 1073741824" returned: 0 in 0.509s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:56 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 Nov 03 18:35:56 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:57 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0" returned: 0 in 0.275s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337292a5-4a10-4b69-8f28-0ece3a7eb752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8975aa-c430-4ee4-8f64-cc248681eab0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dd11d1-fbab-4aad-a707-f7e05851a0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Volume volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 (cc8975aa-c430-4ee4-8f64-cc248681eab0): created successfully Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5dd11d1-fbab-4aad-a707-f7e05851a0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Flow 'volume_create_manager' (3b3bf630-0b87-4efb-a727-f750be94acf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c9ce908e-a12f-4b55-969e-e55f961891e8 tempest-VolumesCloneTest-1016092583 None] Created volume successfully. Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Flow 'volume_create_manager' (ce490b9a-ccc2-446c-8401-a8770359d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3404ef-5b7f-4442-b928-9d0f69fb0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3404ef-5b7f-4442-b928-9d0f69fb0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1340528709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8eec58e-52a0-467b-afc3-9221361a75bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2220ce4c514e48a544f380db8268fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:35:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=cc8975aa-c430-4ee4-8f64-cc248681eab0,status='creating',terminated_at=None,updated_at=2026-11-03T17:35:59Z,use_quota=True,user_id='456d8e1a33e8426a9eebcb749d50ca88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5090d5-25a1-4600-a8e4-61876b5d16ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5090d5-25a1-4600-a8e4-61876b5d16ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14653e62-f02b-499d-9b33-eaec1688d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14653e62-f02b-499d-9b33-eaec1688d8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f8eec58e-52a0-467b-afc3-9221361a75bb', 'volume_name': 'volume-f8eec58e-52a0-467b-afc3-9221361a75bb', 'volume_size': 2, 'source_volid': 'cc8975aa-c430-4ee4-8f64-cc248681eab0', 'source_volstatus': 'available'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3832bf7-e24f-4171-b02d-bb509a676f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3832bf7-e24f-4171-b02d-bb509a676f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42108e5-43cf-4d61-b9ba-38f3f84ae4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:35:58 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Volume f8eec58e-52a0-467b-afc3-9221361a75bb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f8eec58e-52a0-467b-afc3-9221361a75bb', 'volume_size': 2, 'source_volid': 'cc8975aa-c430-4ee4-8f64-cc248681eab0', 'source_volstatus': 'available'} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:58 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Cloning volume cc8975aa-c430-4ee4-8f64-cc248681eab0 to volume f8eec58e-52a0-467b-afc3-9221361a75bb Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Creating offline snapshot f43f2053-9eae-49be-8a9a-e4c43e0407ec of volume cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80ee5a9-a812-4c21-bd86-dcfc21f3b800]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:35:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:59 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 Nov 03 18:35:59 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:59 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0" returned: 0 in 0.493s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:59 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec 1G Nov 03 18:35:59 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:59 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:35:59 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:35:59 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.318s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:35:59 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec 1G" returned: 0 in 0.507s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:35:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:35:59 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec Nov 03 18:35:59 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Flow 'volume_create_manager' (12e4f673-d693-40a0-8292-97d8d2be8275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3561e1c8-e532-4d43-a157-f0b9e7726119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3561e1c8-e532-4d43-a157-f0b9e7726119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1235515080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93891ce9-53bc-45d1-aec5-38b43de5fecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f8260413f4bc9a714b759c0e6f30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:00Z,use_quota=True,user_id='c68fd4c703cc49c4bfb78b6f682f598b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1663a5b-a6c5-4cc3-b87e-13197b5b630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1663a5b-a6c5-4cc3-b87e-13197b5b630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a03e7b-2d17-4365-88fe-0594cf599e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a03e7b-2d17-4365-88fe-0594cf599e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93891ce9-53bc-45d1-aec5-38b43de5fecf', 'volume_name': 'volume-93891ce9-53bc-45d1-aec5-38b43de5fecf', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cd25e3-5bec-48a6-840f-922af7cc4476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cd25e3-5bec-48a6-840f-922af7cc4476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9691a444-d32b-43ca-b32d-da57ba0cca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Volume 93891ce9-53bc-45d1-aec5-38b43de5fecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93891ce9-53bc-45d1-aec5-38b43de5fecf', 'volume_size': 1} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:00 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec" returned: 0 in 0.398s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:00 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec is being set with open permissions: ugo+rw Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:00 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec Nov 03 18:36:00 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:36:00 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Flow 'volume_create_manager' (d9f333d1-9d63-413a-9326-27e0938db179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517fdde7-df90-48e3-b8a8-0fede7f21a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec" returned: 0 in 0.315s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517fdde7-df90-48e3-b8a8-0fede7f21a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1196604428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f9d781-cb68-4615-a02d-d4f9cb03ecbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f8260413f4bc9a714b759c0e6f30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:01Z,use_quota=True,user_id='c68fd4c703cc49c4bfb78b6f682f598b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f213a7-3da6-4b58-9825-8f6273fa713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f213a7-3da6-4b58-9825-8f6273fa713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0046f8-46ea-46f3-a8b8-cd1bbb89a5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0046f8-46ea-46f3-a8b8-cd1bbb89a5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f9d781-cb68-4615-a02d-d4f9cb03ecbf', 'volume_name': 'volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e78efcf-fe4b-4cce-890a-ed59f6e7c1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e78efcf-fe4b-4cce-890a-ed59f6e7c1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd735d58-9394-4ceb-a2d3-eedb8b42144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Volume 36f9d781-cb68-4615-a02d-d4f9cb03ecbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf', 'volume_size': 1} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:00 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info Nov 03 18:36:00 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:01 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info" returned: 0 in 0.272s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:01 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info is being set with open permissions: ugo+rw Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:01 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info Nov 03 18:36:01 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:01 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.info" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "cinder-quobyte-f8eec58e-52a0-467b-afc3-9221361a75bb" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-f8eec58e-52a0-467b-afc3-9221361a75bb" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] snapshot: f43f2053-9eae-49be-8a9a-e4c43e0407ec, volume: f8eec58e-52a0-467b-afc3-9221361a75bb, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf032fee-7547-4bb8-b926-4b621f825e20]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:01 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec Nov 03 18:36:01 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:01 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec" returned: 0 in 0.382s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8975aa-c430-4ee4-8f64-cc248681eab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1a1e2b-58d2-401e-825e-00b8b44a82d7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:01 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 Nov 03 18:36:01 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:02 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0" returned: 0 in 0.371s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:36:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:36:02 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:36:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:02 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb Nov 03 18:36:02 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:09 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb" returned: 0 in 7.538s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:36:09 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Converted 1024.00 MB image at 135.81 MB/s Nov 03 18:36:09 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb is being set with open permissions: ugo+rw Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:09 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb Nov 03 18:36:09 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:09 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb" returned: 0 in 0.274s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-f8eec58e-52a0-467b-afc3-9221361a75bb" released by "_copy_volume_from_snapshot" :: held 8.643s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "cinder-quobyte-f43f2053-9eae-49be-8a9a-e4c43e0407ec" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-f43f2053-9eae-49be-8a9a-e4c43e0407ec" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Deleting offline snapshot f43f2053-9eae-49be-8a9a-e4c43e0407ec of volume cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] snapshot_file for this snap is: volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a088ba6-ff5b-435f-8524-4073c5734775]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:10 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec Nov 03 18:36:10 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:10 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec" returned: 0 in 0.443s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8975aa-c430-4ee4-8f64-cc248681eab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c3e1b4-b670-4b44-aa58-00dfba24e5ac]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:10 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=20,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:36:10 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 Nov 03 18:36:10 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:11 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0" returned: 0 in 0.909s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:11 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec Nov 03 18:36:11 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:11 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:11 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec Nov 03 18:36:11 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:12 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0.f43f2053-9eae-49be-8a9a-e4c43e0407ec" returned: 0 in 0.277s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-f43f2053-9eae-49be-8a9a-e4c43e0407ec" released by "_delete_snapshot" :: held 2.172s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.320s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.884s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1235515080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93891ce9-53bc-45d1-aec5-38b43de5fecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f8260413f4bc9a714b759c0e6f30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:00Z,use_quota=True,user_id='c68fd4c703cc49c4bfb78b6f682f598b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Creating volume 93891ce9-53bc-45d1-aec5-38b43de5fecf {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:36:12 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:12 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf 1073741824 Nov 03 18:36:12 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42108e5-43cf-4d61-b9ba-38f3f84ae4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8eec58e-52a0-467b-afc3-9221361a75bb', 'volume_size': 2, 'source_volid': 'cc8975aa-c430-4ee4-8f64-cc248681eab0', 'source_volstatus': 'available'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ff5211-d7b7-43b3-903b-d9762890ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Volume volume-f8eec58e-52a0-467b-afc3-9221361a75bb (f8eec58e-52a0-467b-afc3-9221361a75bb): created successfully Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ff5211-d7b7-43b3-903b-d9762890ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Flow 'volume_create_manager' (ce490b9a-ccc2-446c-8401-a8770359d712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f1617fdb-c3ae-4096-82b0-67b912df5f15 tempest-VolumesCloneTest-1016092583 None] Created volume successfully. Nov 03 18:36:12 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf 1073741824" returned: 0 in 0.529s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:12 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf Nov 03 18:36:12 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:13 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.342s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1196604428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f9d781-cb68-4615-a02d-d4f9cb03ecbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61f8260413f4bc9a714b759c0e6f30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:01Z,use_quota=True,user_id='c68fd4c703cc49c4bfb78b6f682f598b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Creating volume 36f9d781-cb68-4615-a02d-d4f9cb03ecbf {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:36:13 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9691a444-d32b-43ca-b32d-da57ba0cca3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93891ce9-53bc-45d1-aec5-38b43de5fecf', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61341985-db9b-4566-97b9-bcbde6b25e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:13 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf 1073741824 Nov 03 18:36:13 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Volume volume-93891ce9-53bc-45d1-aec5-38b43de5fecf (93891ce9-53bc-45d1-aec5-38b43de5fecf): created successfully Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61341985-db9b-4566-97b9-bcbde6b25e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Flow 'volume_create_manager' (12e4f673-d693-40a0-8292-97d8d2be8275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fe5754ca-8622-4c75-b8b6-2c8e44c74c1d tempest-TestServerVolumeAttachmentScenario-865797920 None] Created volume successfully. Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "cinder-f8eec58e-52a0-467b-afc3-9221361a75bb-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-f8eec58e-52a0-467b-afc3-9221361a75bb-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "cinder-quobyte-f8eec58e-52a0-467b-afc3-9221361a75bb" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-f8eec58e-52a0-467b-afc3-9221361a75bb" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f7cccb-3a86-4a5d-943d-0fd4d446d878]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:13 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf 1073741824" returned: 0 in 0.748s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:13 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf Nov 03 18:36:13 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:13 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb Nov 03 18:36:13 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:14 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf" returned: 0 in 0.320s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd735d58-9394-4ceb-a2d3-eedb8b42144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635e6e26-ca63-4e99-ab9d-220730e80471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:14 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb" returned: 0 in 0.465s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Volume volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf (36f9d781-cb68-4615-a02d-d4f9cb03ecbf): created successfully Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635e6e26-ca63-4e99-ab9d-220730e80471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Flow 'volume_create_manager' (d9f333d1-9d63-413a-9326-27e0938db179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:14 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb Nov 03 18:36:14 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1da90fbb-6845-4e0e-bac7-00e4898ebc93 tempest-TestServerVolumeAttachmentScenario-865797920 None] Created volume successfully. Nov 03 18:36:14 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-f8eec58e-52a0-467b-afc3-9221361a75bb" returned: 0 in 0.273s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-f8eec58e-52a0-467b-afc3-9221361a75bb" released by "delete_volume" :: held 0.798s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Created reservations ['d46efddc-81c1-498a-8161-3602e2a682a8', '67f77382-bee0-4b52-be7c-0304b0f614f0', 'cf8deaea-10c3-4733-9405-480b46fbfa45', 'a06e275b-ba4c-4a71-9c28-8b59f199f5c9'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:14 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:14 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Acquiring lock "cinder-cc8975aa-c430-4ee4-8f64-cc248681eab0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Lock "cinder-cc8975aa-c430-4ee4-8f64-cc248681eab0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Acquiring lock "cinder-quobyte-cc8975aa-c430-4ee4-8f64-cc248681eab0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-cc8975aa-c430-4ee4-8f64-cc248681eab0" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:15 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.448s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Deleted volume successfully. Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9e0b8-abdb-4c94-99ef-cbc770aa40d6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a05acbc-fdb5-4a1d-8617-3374a69951b8 tempest-VolumesCloneTest-1016092583 None] Lock "cinder-f8eec58e-52a0-467b-afc3-9221361a75bb-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:15 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 Nov 03 18:36:15 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:15 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0" returned: 0 in 0.423s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:15 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0 Nov 03 18:36:15 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:15 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cc8975aa-c430-4ee4-8f64-cc248681eab0" returned: 0 in 0.288s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Lock "cinder-quobyte-cc8975aa-c430-4ee4-8f64-cc248681eab0" released by "delete_volume" :: held 0.800s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:15 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Created reservations ['9228f457-0ddb-411d-bba2-46af36c232e5', '4d69f223-d964-42a5-8ecc-a90077456824', '6a713a56-66eb-4639-bc89-51ffbe6a73d6', '68b1735d-c201-49f4-b38c-f221f9ca259a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:16 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:16 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:16 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Deleted volume successfully. Nov 03 18:36:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d84ea5aa-b250-440b-9f34-db65d8e1d9ec tempest-VolumesCloneTest-1016092583 None] Lock "cinder-cc8975aa-c430-4ee4-8f64-cc248681eab0-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Flow 'volume_create_manager' (789c1407-f938-410f-bb14-a0a77521938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f49a07d-1c31-45b3-b4e8-696066f9bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f49a07d-1c31-45b3-b4e8-696066f9bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-428264929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a0933c-b3b6-42c0-8861-a847cf0296b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e958df98234d68baa5ae9ca519085b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:20Z,use_quota=True,user_id='63a2300c72bf45d7906c35077d44af36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38945706-dc40-4a6e-854b-25d93d45e736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38945706-dc40-4a6e-854b-25d93d45e736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47847cb7-35f0-4014-b933-2c8f7e21c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47847cb7-35f0-4014-b933-2c8f7e21c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a0933c-b3b6-42c0-8861-a847cf0296b3', 'volume_name': 'volume-34a0933c-b3b6-42c0-8861-a847cf0296b3', 'volume_size': 2}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6ae824-84a9-4e02-84ac-6b1ed8c16442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6ae824-84a9-4e02-84ac-6b1ed8c16442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37620b8f-e4b0-40d6-a6ea-2395ca518e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:19 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Volume 34a0933c-b3b6-42c0-8861-a847cf0296b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a0933c-b3b6-42c0-8861-a847cf0296b3', 'volume_size': 2} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-428264929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a0933c-b3b6-42c0-8861-a847cf0296b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e958df98234d68baa5ae9ca519085b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:20Z,use_quota=True,user_id='63a2300c72bf45d7906c35077d44af36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Creating volume 34a0933c-b3b6-42c0-8861-a847cf0296b3 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:36:19 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:36:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 2147483648 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:19 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 2147483648 Nov 03 18:36:19 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:20 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 2147483648" returned: 0 in 0.457s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:20 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 Nov 03 18:36:20 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:20 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3" returned: 0 in 0.276s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37620b8f-e4b0-40d6-a6ea-2395ca518e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a0933c-b3b6-42c0-8861-a847cf0296b3', 'volume_size': 2}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc55c4d-a15d-4bf4-be01-5909bef0ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Volume volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 (34a0933c-b3b6-42c0-8861-a847cf0296b3): created successfully Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc55c4d-a15d-4bf4-be01-5909bef0ca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Flow 'volume_create_manager' (789c1407-f938-410f-bb14-a0a77521938e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a08d65ae-987f-4443-af1e-3eff12c3b8ab tempest-VolumesCloneNegativeTest-2065869749 None] Created volume successfully. Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Acquiring lock "cinder-34a0933c-b3b6-42c0-8861-a847cf0296b3-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Lock "cinder-34a0933c-b3b6-42c0-8861-a847cf0296b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Acquiring lock "cinder-quobyte-34a0933c-b3b6-42c0-8861-a847cf0296b3" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Lock "cinder-quobyte-34a0933c-b3b6-42c0-8861-a847cf0296b3" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bf2472-3e5d-44fb-abd4-0ba10f8ff66c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:22 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 Nov 03 18:36:22 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:22 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3" returned: 0 in 0.402s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:22 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3 Nov 03 18:36:22 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:22 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-34a0933c-b3b6-42c0-8861-a847cf0296b3" returned: 0 in 0.264s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Lock "cinder-quobyte-34a0933c-b3b6-42c0-8861-a847cf0296b3" released by "delete_volume" :: held 0.714s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Created reservations ['d2cac2cf-28d4-46c4-851b-f3b65cd43536', 'fdb99036-86fb-4f67-933a-3b8f3299b950', '08819873-47f2-490e-85e0-7d57f141af65', '4d422ca4-076d-4279-b107-2ac1b262f276'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:22 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:22 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:23 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:23 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Deleted volume successfully. Nov 03 18:36:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af8690ed-888c-4503-82b0-9cbd2948c851 tempest-VolumesCloneNegativeTest-2065869749 None] Lock "cinder-34a0933c-b3b6-42c0-8861-a847cf0296b3-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:26 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:36:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Flow 'volume_create_manager' (ef97fc99-c023-48d0-a503-36062b7893d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c91656-d32a-4d56-b99e-41e2fc45e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c91656-d32a-4d56-b99e-41e2fc45e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-789517215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2f69d0-783b-4417-87af-25b564198be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1b2e4a35cc460cb8a9516cee252afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:27Z,use_quota=True,user_id='913026914ebd439fbe9e8747d82660fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518f6d5f-5204-43df-ab77-9408498f7a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518f6d5f-5204-43df-ab77-9408498f7a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6487e1cd-bf0e-459e-8398-e0cec24fca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6487e1cd-bf0e-459e-8398-e0cec24fca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac2f69d0-783b-4417-87af-25b564198be4', 'volume_name': 'volume-ac2f69d0-783b-4417-87af-25b564198be4', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2f09c5-c28a-487c-be0a-c6f52c513c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2f09c5-c28a-487c-be0a-c6f52c513c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb22b7f-c69f-4361-b026-9644f2c2957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:27 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Volume ac2f69d0-783b-4417-87af-25b564198be4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac2f69d0-783b-4417-87af-25b564198be4', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Trying to clone ac2f69d0-783b-4417-87af-25b564198be4 from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:36:27 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Image download 20.69 MB at 20.69 MB/s Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf09e223-1d75-432a-9e7a-1d14b186debb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:27 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD Nov 03 18:36:27 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:27 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb is fetched for user 913026914ebd439fbe9e8747d82660fb. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c412d40d-ea88-4ad8-bf75-e0e8a711993c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:28 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD Nov 03 18:36:28 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:28 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD" returned: 0 in 0.335s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-789517215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2f69d0-783b-4417-87af-25b564198be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1b2e4a35cc460cb8a9516cee252afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:27Z,use_quota=True,user_id='913026914ebd439fbe9e8747d82660fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Creating volume ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:36:28 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:28 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 1073741824 Nov 03 18:36:28 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:28 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 1073741824" returned: 0 in 0.417s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:28 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 Nov 03 18:36:28 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:29 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Attempting download of 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume ac2f69d0-783b-4417-87af-25b564198be4. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e005799e-6d8d-4aac-b274-105670bdf332]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:29 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u Nov 03 18:36:29 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:29 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u" returned: 0 in 0.321s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:29 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u Nov 03 18:36:29 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:29 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u" returned: 1 in 0.320s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_vaz2065u' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc04747-5873-46e4-bd82-5a1a70e80e4e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:29 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD Nov 03 18:36:29 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:30 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:30 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] 3cc5f1a8-28a8-4446-80b6-6636c7f415bb was qcow2, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:36:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:30 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 Nov 03 18:36:30 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:31 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4" returned: 0 in 1.778s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:31 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_o90rshc3devstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:36:31 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Converted 112.00 MB image at 62.93 MB/s Nov 03 18:36:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:31 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 1G Nov 03 18:36:31 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:32 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 1G" returned: 0 in 0.370s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Downloaded image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume ac2f69d0-783b-4417-87af-25b564198be4 successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb for user 913026914ebd439fbe9e8747d82660fb is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Marking volume ac2f69d0-783b-4417-87af-25b564198be4 as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Copying metadata from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb to ac2f69d0-783b-4417-87af-25b564198be4. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Creating volume glance metadata for volume ac2f69d0-783b-4417-87af-25b564198be4 backed by image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb22b7f-c69f-4361-b026-9644f2c2957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2f69d0-783b-4417-87af-25b564198be4', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4548222-94f7-496a-955e-a2090ecd1dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:32 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Volume volume-ac2f69d0-783b-4417-87af-25b564198be4 (ac2f69d0-783b-4417-87af-25b564198be4): created successfully Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4548222-94f7-496a-955e-a2090ecd1dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Flow 'volume_create_manager' (ef97fc99-c023-48d0-a503-36062b7893d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-759c4815-18a6-44fa-a523-606f66da84f8 tempest-VolumesExtendTest-739620952 None] Created volume successfully. Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6543e9f-3cf1-4a43-a330-c38a717d77e3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:33 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 Nov 03 18:36:33 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:33 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4" returned: 0 in 0.404s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 2G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 2G" returned: 0 in 0.098s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.526s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-91b51609-6750-4760-8a1a-e91ce3400b81 tempest-VolumesExtendTest-739620952 None] Extend volume completed successfully. Nov 03 18:36:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-ac2f69d0-783b-4417-87af-25b564198be4-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Lock "cinder-ac2f69d0-783b-4417-87af-25b564198be4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-quobyte-ac2f69d0-783b-4417-87af-25b564198be4" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-ac2f69d0-783b-4417-87af-25b564198be4" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:34 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e86283-f36b-4659-9ad0-815e80bc8b09]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:35 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 Nov 03 18:36:35 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:35 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4" returned: 0 in 0.369s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:35 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4 Nov 03 18:36:35 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:35 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ac2f69d0-783b-4417-87af-25b564198be4" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-ac2f69d0-783b-4417-87af-25b564198be4" released by "delete_volume" :: held 0.677s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Created reservations ['a56b4443-4417-4baa-afcd-32e637bace05', 'd4779a14-5c30-4dcc-aa08-9acfe591e658', 'ed3ef5d0-dd69-443c-8c07-6a351266d01a', '7b3d44e9-685c-4920-8e52-9cb2a67906c0'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:35 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:35 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:35 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.303s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:35 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Deleted volume successfully. Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-99285d2c-d8f8-4ee1-b44e-16d05a309965 tempest-VolumesExtendTest-739620952 None] Lock "cinder-ac2f69d0-783b-4417-87af-25b564198be4-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Flow 'volume_create_manager' (e5c38855-8b1c-4915-be70-d1a22a0154ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03a526d-97a6-4f30-8add-fac91ec212c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f03a526d-97a6-4f30-8add-fac91ec212c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-55434767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d540d0e9-69b6-4319-b233-15d3bfdd9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1b2e4a35cc460cb8a9516cee252afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:36Z,use_quota=True,user_id='913026914ebd439fbe9e8747d82660fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4516cdb-b05f-4ef4-ae71-3e5cd941328c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4516cdb-b05f-4ef4-ae71-3e5cd941328c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24b6ead-1380-4569-a4fe-69657890216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24b6ead-1380-4569-a4fe-69657890216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd540d0e9-69b6-4319-b233-15d3bfdd9422', 'volume_name': 'volume-d540d0e9-69b6-4319-b233-15d3bfdd9422', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62db4916-0683-401f-9d0c-644d62ec90f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62db4916-0683-401f-9d0c-644d62ec90f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9a0587-174a-4e75-99ea-34f197b3cc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:36 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Volume d540d0e9-69b6-4319-b233-15d3bfdd9422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d540d0e9-69b6-4319-b233-15d3bfdd9422', 'volume_size': 1} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-55434767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d540d0e9-69b6-4319-b233-15d3bfdd9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1b2e4a35cc460cb8a9516cee252afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:36Z,use_quota=True,user_id='913026914ebd439fbe9e8747d82660fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Creating volume d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:36:36 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-c7073ef8-1688-46ca-ad0a-24d39438be99 req-269b8c9a-ef46-4356-8367-60833c9c1331 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:36 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 1073741824 Nov 03 18:36:36 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:37 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 1073741824" returned: 0 in 0.402s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:INSERT=27,cinder:UPDATE=86,cinder:SELECT=60,cinder:DELETE=8 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:37 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 Nov 03 18:36:37 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:37 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422" returned: 0 in 0.239s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-c7073ef8-1688-46ca-ad0a-24d39438be99 req-269b8c9a-ef46-4356-8367-60833c9c1331 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.661s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f9a0587-174a-4e75-99ea-34f197b3cc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d540d0e9-69b6-4319-b233-15d3bfdd9422', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a112e299-4d59-47d9-990d-7dab4145931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-c7073ef8-1688-46ca-ad0a-24d39438be99 req-269b8c9a-ef46-4356-8367-60833c9c1331 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:37 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Volume volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 (d540d0e9-69b6-4319-b233-15d3bfdd9422): created successfully Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a112e299-4d59-47d9-990d-7dab4145931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Flow 'volume_create_manager' (e5c38855-8b1c-4915-be70-d1a22a0154ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0987e618-392c-4677-8adf-e03031d87f34 tempest-VolumesExtendTest-739620952 None] Created volume successfully. Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-c7073ef8-1688-46ca-ad0a-24d39438be99 req-269b8c9a-ef46-4356-8367-60833c9c1331 tempest-TestServerVolumeAttachmentScenario-865797920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-93891ce9-53bc-45d1-aec5-38b43de5fecf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c3de4eab-4de8-4845-8f14-b3697ccb4525', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:36:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-c7073ef8-1688-46ca-ad0a-24d39438be99 req-269b8c9a-ef46-4356-8367-60833c9c1331 tempest-TestServerVolumeAttachmentScenario-865797920 None] attachment_update completed successfully. Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Creating offline snapshot 4fd3f5d0-7737-4fb8-9ccf-893489e51007 of volume d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[13df2530-34e1-4e38-a9f5-8b892d62964c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:37 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 Nov 03 18:36:37 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:38 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422" returned: 0 in 0.408s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:38 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 1G Nov 03 18:36:38 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:38 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 1G" returned: 0 in 0.412s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:38 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 Nov 03 18:36:38 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:38 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007" returned: 0 in 0.296s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:38 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 is being set with open permissions: ugo+rw Nov 03 18:36:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:38 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 Nov 03 18:36:38 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:39 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:39 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info Nov 03 18:36:39 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:39 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:39 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info is being set with open permissions: ugo+rw Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:39 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info Nov 03 18:36:39 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:39 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.info" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:39 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-37cba238-2713-405c-94d2-2f6390d47133 tempest-VolumesExtendTest-739620952 None] Create snapshot completed successfully Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29e0f20-2209-40b2-859b-d87f291a7ba1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:40 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 Nov 03 18:36:40 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:40 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422" returned: 0 in 0.368s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 2G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 2G" returned: 0 in 0.139s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.545s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:40 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b8a92765-c8d4-417c-b354-096e74c0383d tempest-VolumesExtendTest-739620952 None] Extend volume completed successfully. Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-4fd3f5d0-7737-4fb8-9ccf-893489e51007-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Lock "cinder-4fd3f5d0-7737-4fb8-9ccf-893489e51007-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-quobyte-d540d0e9-69b6-4319-b233-15d3bfdd9422" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-d540d0e9-69b6-4319-b233-15d3bfdd9422" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-quobyte-4fd3f5d0-7737-4fb8-9ccf-893489e51007" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-4fd3f5d0-7737-4fb8-9ccf-893489e51007" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Deleting offline snapshot 4fd3f5d0-7737-4fb8-9ccf-893489e51007 of volume d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] snapshot_file for this snap is: volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-50798def-cc82-4812-b57e-27fc172f7bfe req-2251347d-90a1-4f4d-b831-fdc06e4934d9 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-50798def-cc82-4812-b57e-27fc172f7bfe req-2251347d-90a1-4f4d-b831-fdc06e4934d9 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c36b3-cb75-4f78-92d9-5425f5a5c54f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-50798def-cc82-4812-b57e-27fc172f7bfe req-2251347d-90a1-4f4d-b831-fdc06e4934d9 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-50798def-cc82-4812-b57e-27fc172f7bfe req-2251347d-90a1-4f4d-b831-fdc06e4934d9 tempest-TestServerVolumeAttachmentScenario-865797920 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '806b2c80-23c6-4b56-93a6-7414e8a2a160', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:36:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-50798def-cc82-4812-b57e-27fc172f7bfe req-2251347d-90a1-4f4d-b831-fdc06e4934d9 tempest-TestServerVolumeAttachmentScenario-865797920 None] attachment_update completed successfully. Nov 03 18:36:41 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 Nov 03 18:36:41 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:41 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007" returned: 0 in 0.398s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d540d0e9-69b6-4319-b233-15d3bfdd9422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d75cd65-ccde-45d9-9063-90a84cab5e4b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:41 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 Nov 03 18:36:41 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:42 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422" returned: 0 in 0.393s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:42 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 Nov 03 18:36:42 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:42 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007" returned: 0 in 0.415s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:42 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007 Nov 03 18:36:42 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:42 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422.4fd3f5d0-7737-4fb8-9ccf-893489e51007" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-4fd3f5d0-7737-4fb8-9ccf-893489e51007" released by "_delete_snapshot" :: held 1.579s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-d540d0e9-69b6-4319-b233-15d3bfdd9422" released by "delete_snapshot" :: held 1.608s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-81469f79-d3c6-44ab-9414-4110123b79f2 req-4eeabe82-4f58-430e-9b60-eb4b30ab5151 tempest-TestServerVolumeAttachmentScenario-865797920 None] Terminate volume connection completed successfully. Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-81469f79-d3c6-44ab-9414-4110123b79f2 req-4eeabe82-4f58-430e-9b60-eb4b30ab5151 tempest-TestServerVolumeAttachmentScenario-865797920 None] Deleting attachment 806b2c80-23c6-4b56-93a6-7414e8a2a160. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Created reservations ['5f32ca3e-9172-482b-bb1a-32762f7ce29d', '30e8b5ed-c928-454e-bb23-a02f8a157d30', 'dcc23fed-a670-47b0-adb2-ae681fb322c2', 'a6c3181c-ad5e-4207-b24d-616e917c3625'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:42 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Delete snapshot completed successfully. Nov 03 18:36:42 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-65882e2f-827f-4f9d-9a0d-2aa2307da7a8 tempest-VolumesExtendTest-739620952 None] Lock "cinder-4fd3f5d0-7737-4fb8-9ccf-893489e51007-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-d540d0e9-69b6-4319-b233-15d3bfdd9422-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Lock "cinder-d540d0e9-69b6-4319-b233-15d3bfdd9422-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Acquiring lock "cinder-quobyte-d540d0e9-69b6-4319-b233-15d3bfdd9422" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-d540d0e9-69b6-4319-b233-15d3bfdd9422" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a6893-7c1b-4025-9d42-f3d66b7a6c5a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:43 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 Nov 03 18:36:43 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:43 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:43 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422 Nov 03 18:36:43 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:44 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d540d0e9-69b6-4319-b233-15d3bfdd9422" returned: 0 in 0.271s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Lock "cinder-quobyte-d540d0e9-69b6-4319-b233-15d3bfdd9422" released by "delete_volume" :: held 0.709s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Created reservations ['0fbdeed7-b0ae-4d2b-9914-8c9c356c7650', '10b46844-f82f-469b-9ebf-87d5f6acd5bd', '2eb5b8b4-be65-4c9b-b9c0-5d2b5d76281b', 'ba95e838-6782-41ca-82a4-9f219503f7e5'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:44 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:44 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-492e678e-2325-42d1-9c5a-f25c6fdd80f7 req-3ad63aab-2f34-4662-9dd0-2a5b7c0b262b tempest-TestServerVolumeAttachmentScenario-865797920 None] Terminate volume connection completed successfully. Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-492e678e-2325-42d1-9c5a-f25c6fdd80f7 req-3ad63aab-2f34-4662-9dd0-2a5b7c0b262b tempest-TestServerVolumeAttachmentScenario-865797920 None] Deleting attachment c3de4eab-4de8-4845-8f14-b3697ccb4525. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:36:44 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.255s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Deleted volume successfully. Nov 03 18:36:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-96ed7d9d-2317-4964-bdd1-021257986359 tempest-VolumesExtendTest-739620952 None] Lock "cinder-d540d0e9-69b6-4319-b233-15d3bfdd9422-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "cinder-36f9d781-cb68-4615-a02d-d4f9cb03ecbf-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-36f9d781-cb68-4615-a02d-d4f9cb03ecbf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "cinder-quobyte-36f9d781-cb68-4615-a02d-d4f9cb03ecbf" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-quobyte-36f9d781-cb68-4615-a02d-d4f9cb03ecbf" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6d03db-907b-49dc-95c5-5780cb555eb3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:49 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf Nov 03 18:36:49 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:49 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf" returned: 0 in 0.385s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:49 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf Nov 03 18:36:49 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:49 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-36f9d781-cb68-4615-a02d-d4f9cb03ecbf" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-quobyte-36f9d781-cb68-4615-a02d-d4f9cb03ecbf" released by "delete_volume" :: held 0.689s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Created reservations ['ec844369-2e18-4aa2-ad7c-18c206806bb8', '606ce5ef-768b-4ee3-b4cb-f204fdc1ac10', '60a27b3b-ffa5-450a-a149-d904eef89720', 'c5330dac-4287-4160-9769-9b58decc1d06'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:50 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:50 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:50 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Deleted volume successfully. Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "cinder-93891ce9-53bc-45d1-aec5-38b43de5fecf-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-2b4d6a9f-b9d0-447b-b4c4-a2ae09f26979 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-36f9d781-cb68-4615-a02d-d4f9cb03ecbf-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-93891ce9-53bc-45d1-aec5-38b43de5fecf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "cinder-quobyte-93891ce9-53bc-45d1-aec5-38b43de5fecf" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-quobyte-93891ce9-53bc-45d1-aec5-38b43de5fecf" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ffafe-8199-438a-b8d5-15de0e6f887b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:50 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf Nov 03 18:36:50 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:50 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf" returned: 0 in 0.382s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:50 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf Nov 03 18:36:50 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:51 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-93891ce9-53bc-45d1-aec5-38b43de5fecf" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-quobyte-93891ce9-53bc-45d1-aec5-38b43de5fecf" released by "delete_volume" :: held 0.679s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Created reservations ['4190cd18-6709-4087-8d68-3365ae02e02c', '6ea41778-196d-41f1-a29f-8fd62d339758', 'f68de085-8d80-4253-a463-a28b55567d23', '1debe371-b004-4379-a43d-15a39a13cb12'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:51 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:51 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:51 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Deleted volume successfully. Nov 03 18:36:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1b328936-b3f9-4068-a840-a7b3622ad072 tempest-TestServerVolumeAttachmentScenario-865797920 None] Lock "cinder-93891ce9-53bc-45d1-aec5-38b43de5fecf-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Flow 'volume_create_manager' (5b3c0c9c-3c53-4e51-b56e-133912899dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd5d5d0-b8d5-47e7-995c-c473d08e15c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd5d5d0-b8d5-47e7-995c-c473d08e15c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1788180332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413dede3-875a-4c03-a328-ad59608eb85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4b557ca3fe4a58ab9ebc524b0cbbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:52Z,use_quota=True,user_id='5aeb1673ab8341beb39e85b6a0221880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53303c-aafa-49b4-84c3-f41d53c26f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53303c-aafa-49b4-84c3-f41d53c26f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505dd9e5-41b0-4384-bc78-46784c50d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505dd9e5-41b0-4384-bc78-46784c50d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413dede3-875a-4c03-a328-ad59608eb85b', 'volume_name': 'volume-413dede3-875a-4c03-a328-ad59608eb85b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f181e0d0-2be5-4bdb-91aa-a4d49416261e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f181e0d0-2be5-4bdb-91aa-a4d49416261e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55611aa-0df5-48be-98fc-3645f885f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Volume 413dede3-875a-4c03-a328-ad59608eb85b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413dede3-875a-4c03-a328-ad59608eb85b', 'volume_size': 1} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1788180332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413dede3-875a-4c03-a328-ad59608eb85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4b557ca3fe4a58ab9ebc524b0cbbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:36:52Z,use_quota=True,user_id='5aeb1673ab8341beb39e85b6a0221880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Creating volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:36:52 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:52 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b 1073741824 Nov 03 18:36:52 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:52 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b 1073741824" returned: 0 in 0.438s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:52 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b Nov 03 18:36:52 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:53 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b" returned: 0 in 0.280s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55611aa-0df5-48be-98fc-3645f885f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413dede3-875a-4c03-a328-ad59608eb85b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e77a977-4bf8-4095-8d2f-f0005b3dce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:36:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Volume volume-413dede3-875a-4c03-a328-ad59608eb85b (413dede3-875a-4c03-a328-ad59608eb85b): created successfully Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e77a977-4bf8-4095-8d2f-f0005b3dce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Flow 'volume_create_manager' (5b3c0c9c-3c53-4e51-b56e-133912899dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:36:53 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-389e8fd6-a3c7-4217-996a-119bd6de8467 tempest-VolumesSnapshotListTestJSON-1633510772 None] Created volume successfully. Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Creating offline snapshot aaa7b237-f982-4a94-8d36-28fc807edc23 of volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84f6ff-f64a-434f-ab55-1b3066c1cef5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:53 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b Nov 03 18:36:53 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:53 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:53 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 1G Nov 03 18:36:53 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:54 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 1G" returned: 0 in 0.412s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:54 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:36:54 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:54 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.277s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:54 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 is being set with open permissions: ugo+rw Nov 03 18:36:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:54 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:36:54 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:54 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.232s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:54 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info Nov 03 18:36:54 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:55 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:55 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info is being set with open permissions: ugo+rw Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:55 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info Nov 03 18:36:55 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:55 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.info" returned: 0 in 0.257s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.944s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e61db0e3-621c-4cb6-b3a9-f5342759be55 tempest-VolumesSnapshotListTestJSON-1633510772 None] Create snapshot completed successfully Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Creating offline snapshot b7958cbb-feec-437a-afe7-c9285abd72ab of volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b45bc2-06d1-44c5-9c60-2dc572223413]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:55 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:36:55 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:56 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.423s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:56 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab 1G Nov 03 18:36:56 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:56 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab 1G" returned: 0 in 0.473s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:56 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:36:56 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:56 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.338s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:56 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab is being set with open permissions: ugo+rw Nov 03 18:36:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:56 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:36:57 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:57 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.255s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.592s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-abdbb2b0-e419-4600-8ebf-6db66260fbb7 tempest-VolumesSnapshotListTestJSON-1633510772 None] Create snapshot completed successfully Nov 03 18:36:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Creating offline snapshot eadd98f5-4a1b-4dec-afdb-d606d43f3af7 of volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0468543-0ca6-4a26-9001-d715abd01d08]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:58 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:36:58 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:58 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.390s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:58 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 1G Nov 03 18:36:58 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:58 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 1G" returned: 0 in 0.443s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:58 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 Nov 03 18:36:58 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:59 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:59 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 is being set with open permissions: ugo+rw Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:59 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 Nov 03 18:36:59 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:59 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7" returned: 0 in 0.302s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.544s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:36:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-60347d6c-963a-47d3-8e49-67da601ce7bf tempest-VolumesSnapshotListTestJSON-1633510772 None] Create snapshot completed successfully Nov 03 18:36:59 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:36:59 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:36:59 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.268s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:36:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-eadd98f5-4a1b-4dec-afdb-d606d43f3af7-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-eadd98f5-4a1b-4dec-afdb-d606d43f3af7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-eadd98f5-4a1b-4dec-afdb-d606d43f3af7" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-eadd98f5-4a1b-4dec-afdb-d606d43f3af7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Deleting offline snapshot eadd98f5-4a1b-4dec-afdb-d606d43f3af7 of volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] snapshot_file for this snap is: volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3353f29a-9a43-4a37-8974-26fba463e2ec]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:01 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 Nov 03 18:37:01 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:01 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7" returned: 0 in 0.405s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[016716f9-5877-4789-97c5-88c202f0cc41]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:01 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:37:01 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:01 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.419s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:37:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:02 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 Nov 03 18:37:02 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:02 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7" returned: 0 in 0.438s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:02 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7 Nov 03 18:37:02 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:02 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.eadd98f5-4a1b-4dec-afdb-d606d43f3af7" returned: 0 in 0.267s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-eadd98f5-4a1b-4dec-afdb-d606d43f3af7" released by "_delete_snapshot" :: held 1.642s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" released by "delete_snapshot" :: held 1.663s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Created reservations ['e5d0a270-11f6-4718-9450-6494199b5420', 'b0ffe014-ac67-455a-a388-ebb3e7b7fca4', '436091d2-a442-4b1a-9bc4-ef4f63cc0437', '2b5b9136-5abe-4413-afb3-628d39011f9e'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:37:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Delete snapshot completed successfully. Nov 03 18:37:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9298a41a-8db1-4fb6-9a04-1c9902116ac5 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-eadd98f5-4a1b-4dec-afdb-d606d43f3af7-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-b7958cbb-feec-437a-afe7-c9285abd72ab-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-b7958cbb-feec-437a-afe7-c9285abd72ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-b7958cbb-feec-437a-afe7-c9285abd72ab" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-b7958cbb-feec-437a-afe7-c9285abd72ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Deleting offline snapshot b7958cbb-feec-437a-afe7-c9285abd72ab of volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] snapshot_file for this snap is: volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[84923676-eda7-44c1-bd8b-cf7532f82653]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:03 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:37:03 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:03 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.392s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4894a5c-c1d5-4625-a869-87a063531652]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:03 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:37:03 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:04 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:04 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:37:04 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:04 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.453s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:04 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab Nov 03 18:37:04 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:04 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.b7958cbb-feec-437a-afe7-c9285abd72ab" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-b7958cbb-feec-437a-afe7-c9285abd72ab" released by "_delete_snapshot" :: held 1.599s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" released by "delete_snapshot" :: held 1.626s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Created reservations ['e5e98286-4cb7-4631-8af4-de7edb4e130a', 'e0198d23-720d-4f8f-8ef6-80271a30c236', '03424a48-e1e3-4370-b1ba-bf10d9229ecb', 'db5e81e2-dc0b-4c38-be6b-f93690e4904d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:37:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Delete snapshot completed successfully. Nov 03 18:37:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4d4fbb8-1464-4949-9fe0-8e11a9a639b1 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-b7958cbb-feec-437a-afe7-c9285abd72ab-delete_snapshot" released by "delete_snapshot" :: held 1.789s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-aaa7b237-f982-4a94-8d36-28fc807edc23-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-aaa7b237-f982-4a94-8d36-28fc807edc23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-aaa7b237-f982-4a94-8d36-28fc807edc23" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-aaa7b237-f982-4a94-8d36-28fc807edc23" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Deleting offline snapshot aaa7b237-f982-4a94-8d36-28fc807edc23 of volume 413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] snapshot_file for this snap is: volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d209f-e2cd-40d2-9f4d-8e1857603cfa]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:05 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:37:05 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:05 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.398s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-413dede3-875a-4c03-a328-ad59608eb85b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d238098c-f838-40a2-a967-c274e0087a8d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:06 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b Nov 03 18:37:06 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:06 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b" returned: 0 in 0.391s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:06 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:37:06 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:06 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.382s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:06 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23 Nov 03 18:37:06 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:06 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b.aaa7b237-f982-4a94-8d36-28fc807edc23" returned: 0 in 0.259s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-aaa7b237-f982-4a94-8d36-28fc807edc23" released by "_delete_snapshot" :: held 1.563s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" released by "delete_snapshot" :: held 1.590s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Created reservations ['2b4e0cde-c1ca-47b1-b7c1-0345bbdeab3e', 'ad087681-b5d4-40f2-bc1a-e6851aaebbd0', '7d576354-7712-432d-b4b4-2f1874670f2e', '1ad0014e-afc7-4823-a305-e696d9060384'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:37:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Delete snapshot completed successfully. Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-45747a35-d151-48a8-8e0e-f76d9f01f7cd tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-aaa7b237-f982-4a94-8d36-28fc807edc23-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-413dede3-875a-4c03-a328-ad59608eb85b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-413dede3-875a-4c03-a328-ad59608eb85b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e5895-2c6e-49e3-a41e-956d2bab2bf0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:07 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b Nov 03 18:37:07 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:08 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:08 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b Nov 03 18:37:08 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:08 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-413dede3-875a-4c03-a328-ad59608eb85b" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-quobyte-413dede3-875a-4c03-a328-ad59608eb85b" released by "delete_volume" :: held 0.699s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Created reservations ['540b509e-590d-4b09-bbef-2851bcfbf2fe', 'a6d6431b-2536-469c-9334-72430cbe85e8', 'ff71a885-3e7d-472d-822a-125649cf77a9', 'ce498929-e3d2-427f-88e5-1a660925017a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:08 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:37:08 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:08 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.314s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:37:08 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Deleted volume successfully. Nov 03 18:37:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8efdd4a4-3414-4f3c-a73c-a25cbf623286 tempest-VolumesSnapshotListTestJSON-1633510772 None] Lock "cinder-413dede3-875a-4c03-a328-ad59608eb85b-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:37:18 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=81,cinder:SELECT=72,cinder:DELETE=6,cinder:INSERT=18 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:37:18 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=105,cinder:SELECT=112,cinder:INSERT=34,cinder:DELETE=9 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Flow 'volume_create_manager' (c71a786b-4a9a-4270-a425-ac9dae72574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02943393-0db1-4d98-830c-d26a492809bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02943393-0db1-4d98-830c-d26a492809bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-966323595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd215f8-a0b4-418b-8960-8de65be9428f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638f315535da4d45b6a5f9887a8a9e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:29Z,use_quota=True,user_id='2d451b67e325465cb4ad076df9c723c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcd8b6d-f664-4855-9d03-ffe89441bf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcd8b6d-f664-4855-9d03-ffe89441bf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c57a8f6-329e-4e64-b9c1-dc744c686ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:29 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c57a8f6-329e-4e64-b9c1-dc744c686ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edd215f8-a0b4-418b-8960-8de65be9428f', 'volume_name': 'volume-edd215f8-a0b4-418b-8960-8de65be9428f', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1e70e8-e2a3-4417-bf7f-e2f37cb134ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1e70e8-e2a3-4417-bf7f-e2f37cb134ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101e770f-8c6d-4986-a286-18ae1fca7c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Volume edd215f8-a0b4-418b-8960-8de65be9428f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edd215f8-a0b4-418b-8960-8de65be9428f', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Trying to clone edd215f8-a0b4-418b-8960-8de65be9428f from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:37:30 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Image download 20.69 MB at 20.69 MB/s Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35715dc-7b5d-40b1-a665-bc5b15143e12]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:30 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD Nov 03 18:37:30 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:30 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:30 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb is fetched for user 2d451b67e325465cb4ad076df9c723c0. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f8df10-1903-4351-a51e-7275e4814990]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:31 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD Nov 03 18:37:31 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:31 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-966323595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd215f8-a0b4-418b-8960-8de65be9428f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='638f315535da4d45b6a5f9887a8a9e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:29Z,use_quota=True,user_id='2d451b67e325465cb4ad076df9c723c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Creating volume edd215f8-a0b4-418b-8960-8de65be9428f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:37:31 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:31 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f 1073741824 Nov 03 18:37:31 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:31 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f 1073741824" returned: 0 in 0.511s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:32 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f Nov 03 18:37:32 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:32 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f" returned: 0 in 0.341s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Attempting download of 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume edd215f8-a0b4-418b-8960-8de65be9428f. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb72e4c3-f916-4525-82b6-ff66d06fb1c8]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:32 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635 Nov 03 18:37:32 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:32 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:32 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635 Nov 03 18:37:32 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:33 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635" returned: 1 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_ori6t635' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca424fc8-f888-453a-a7f6-37af2d6892dc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:33 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD Nov 03 18:37:33 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:33 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] 3cc5f1a8-28a8-4446-80b6-6636c7f415bb was qcow2, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:37:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:33 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f Nov 03 18:37:33 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:35 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f" returned: 0 in 1.869s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3cc5f1a8-28a8-4446-80b6-6636c7f415bb_jzzuhvyddevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:37:35 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Converted 112.00 MB image at 59.88 MB/s Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:35 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f 1G Nov 03 18:37:35 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:35 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f 1G" returned: 0 in 0.329s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Downloaded image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb ((None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}])) to volume edd215f8-a0b4-418b-8960-8de65be9428f successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Temporary image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb for user 2d451b67e325465cb4ad076df9c723c0 is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Marking volume edd215f8-a0b4-418b-8960-8de65be9428f as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Copying metadata from image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb to edd215f8-a0b4-418b-8960-8de65be9428f. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Creating volume glance metadata for volume edd215f8-a0b4-418b-8960-8de65be9428f backed by image 3cc5f1a8-28a8-4446-80b6-6636c7f415bb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101e770f-8c6d-4986-a286-18ae1fca7c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd215f8-a0b4-418b-8960-8de65be9428f', 'volume_size': 1, 'image_id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f996b3d1d58f4232a6d5075d20ecd544', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3cc5f1a8-28a8-4446-80b6-6636c7f415bb', 'created_at': datetime.datetime(2026, 11, 3, 17, 16, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 16, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3cc5f1a8-28a8-4446-80b6-6636c7f415bb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6ff978-8b9a-4405-b9b8-d61708af9890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:35 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Volume volume-edd215f8-a0b4-418b-8960-8de65be9428f (edd215f8-a0b4-418b-8960-8de65be9428f): created successfully Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6ff978-8b9a-4405-b9b8-d61708af9890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:35 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Flow 'volume_create_manager' (c71a786b-4a9a-4270-a425-ac9dae72574a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:37:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-db89fd29-09f9-4f02-815d-5a2cc03201b1 tempest-TestShelveInstance-1221162035 None] Created volume successfully. Nov 03 18:37:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-4a46c539-0cf2-404c-b0e2-5015c0ea9077 req-763656da-3376-495b-9e73-f76ec7418de5 tempest-TestShelveInstance-1221162035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-4a46c539-0cf2-404c-b0e2-5015c0ea9077 req-763656da-3376-495b-9e73-f76ec7418de5 tempest-TestShelveInstance-1221162035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-4a46c539-0cf2-404c-b0e2-5015c0ea9077 req-763656da-3376-495b-9e73-f76ec7418de5 tempest-TestShelveInstance-1221162035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-4a46c539-0cf2-404c-b0e2-5015c0ea9077 req-763656da-3376-495b-9e73-f76ec7418de5 tempest-TestShelveInstance-1221162035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-edd215f8-a0b4-418b-8960-8de65be9428f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c88592ed-ca93-438b-9b4d-1a0ee2c65e26', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:37:40 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-4a46c539-0cf2-404c-b0e2-5015c0ea9077 req-763656da-3376-495b-9e73-f76ec7418de5 tempest-TestShelveInstance-1221162035 None] attachment_update completed successfully. Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Flow 'volume_create_manager' (57b25384-c9c0-4752-8f77-2f22859819bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e555b8-649d-43e2-96a2-e626bc11dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e555b8-649d-43e2-96a2-e626bc11dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1122370724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5490827-b7cc-4f69-a83d-cd728f8322f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3877e2c164e1191a6a7a4f2d88be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:45Z,use_quota=True,user_id='10d0b4f3d59a428ea9d6f4b2f8659cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1158bf-165f-4ad3-8e8c-6c8c174aec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1158bf-165f-4ad3-8e8c-6c8c174aec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d182f72-f050-4812-ba7c-994f9f2a018a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d182f72-f050-4812-ba7c-994f9f2a018a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5490827-b7cc-4f69-a83d-cd728f8322f5', 'volume_name': 'volume-c5490827-b7cc-4f69-a83d-cd728f8322f5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04698f22-8932-4e1c-8dbb-71fbc5bea699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04698f22-8932-4e1c-8dbb-71fbc5bea699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f925fa3-e29a-44dc-bf89-44b4e57ed863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:44 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Volume c5490827-b7cc-4f69-a83d-cd728f8322f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5490827-b7cc-4f69-a83d-cd728f8322f5', 'volume_size': 1} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1122370724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5490827-b7cc-4f69-a83d-cd728f8322f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3877e2c164e1191a6a7a4f2d88be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:37:45Z,use_quota=True,user_id='10d0b4f3d59a428ea9d6f4b2f8659cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Creating volume c5490827-b7cc-4f69-a83d-cd728f8322f5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:37:44 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:37:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:44 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 1073741824 Nov 03 18:37:44 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:45 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 1073741824" returned: 0 in 0.789s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:45 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 Nov 03 18:37:45 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:45 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5" returned: 0 in 0.250s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f925fa3-e29a-44dc-bf89-44b4e57ed863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5490827-b7cc-4f69-a83d-cd728f8322f5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6c9fad-ac78-44fb-8a72-25a6d81ba20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:37:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Volume volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 (c5490827-b7cc-4f69-a83d-cd728f8322f5): created successfully Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6c9fad-ac78-44fb-8a72-25a6d81ba20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:37:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Flow 'volume_create_manager' (57b25384-c9c0-4752-8f77-2f22859819bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:37:45 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3d12dd6c-de6a-4220-954d-98468f1a289d tempest-TestMinimumBasicScenario-1731946379 None] Created volume successfully. Nov 03 18:37:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-5a1eb89a-6947-427c-97c7-726ebfef02b8 req-2d2da6a7-ba37-4092-9503-0a75aba23c21 tempest-TestMinimumBasicScenario-1731946379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-5a1eb89a-6947-427c-97c7-726ebfef02b8 req-2d2da6a7-ba37-4092-9503-0a75aba23c21 tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-5a1eb89a-6947-427c-97c7-726ebfef02b8 req-2d2da6a7-ba37-4092-9503-0a75aba23c21 tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-5a1eb89a-6947-427c-97c7-726ebfef02b8 req-2d2da6a7-ba37-4092-9503-0a75aba23c21 tempest-TestMinimumBasicScenario-1731946379 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-c5490827-b7cc-4f69-a83d-cd728f8322f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea422153-19ce-4361-a827-6c0862a121a4', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:37:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-5a1eb89a-6947-427c-97c7-726ebfef02b8 req-2d2da6a7-ba37-4092-9503-0a75aba23c21 tempest-TestMinimumBasicScenario-1731946379 None] attachment_update completed successfully. Nov 03 18:37:58 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=26,cinder:UPDATE=10,cinder:INSERT=5 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:37:58 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=23,cinder:INSERT=10,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:37:59 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:37:59 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:37:59 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.262s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:37:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:38:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-0e3607b4-ad9e-4df6-8d22-117254ca21c6 req-8fd9da5f-ec1b-488d-833e-2721e395fe9c tempest-TestShelveInstance-1221162035 None] Terminate volume connection completed successfully. Nov 03 18:38:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-0e3607b4-ad9e-4df6-8d22-117254ca21c6 req-8fd9da5f-ec1b-488d-833e-2721e395fe9c tempest-TestShelveInstance-1221162035 None] Deleting attachment c88592ed-ca93-438b-9b4d-1a0ee2c65e26. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:38:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-8cfb41a7-fbd5-4b70-bba0-21d1dbc963c3 req-11b77e0a-a85a-4303-9fa7-cdbe6c881d4e tempest-TestShelveInstance-1221162035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-8cfb41a7-fbd5-4b70-bba0-21d1dbc963c3 req-11b77e0a-a85a-4303-9fa7-cdbe6c881d4e tempest-TestShelveInstance-1221162035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-8cfb41a7-fbd5-4b70-bba0-21d1dbc963c3 req-11b77e0a-a85a-4303-9fa7-cdbe6c881d4e tempest-TestShelveInstance-1221162035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:18 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-8cfb41a7-fbd5-4b70-bba0-21d1dbc963c3 req-11b77e0a-a85a-4303-9fa7-cdbe6c881d4e tempest-TestShelveInstance-1221162035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45', 'name': 'volume-edd215f8-a0b4-418b-8960-8de65be9428f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '857e3796-b8f0-40f7-bb98-a37012837ebb', 'enforce_multipath': True} {{(pid=86841) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 03 18:38:19 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-8cfb41a7-fbd5-4b70-bba0-21d1dbc963c3 req-11b77e0a-a85a-4303-9fa7-cdbe6c881d4e tempest-TestShelveInstance-1221162035 None] attachment_update completed successfully. Nov 03 18:38:29 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:38:29 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:38:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-d0f37dab-8cf2-4bcd-b010-14a1947238b1 req-7fd5b46d-9297-48d5-8337-f6d2a62b4a71 tempest-TestMinimumBasicScenario-1731946379 None] Terminate volume connection completed successfully. Nov 03 18:38:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-d0f37dab-8cf2-4bcd-b010-14a1947238b1 req-7fd5b46d-9297-48d5-8337-f6d2a62b4a71 tempest-TestMinimumBasicScenario-1731946379 None] Deleting attachment ea422153-19ce-4361-a827-6c0862a121a4. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:38:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Acquiring lock "cinder-c5490827-b7cc-4f69-a83d-cd728f8322f5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Lock "cinder-c5490827-b7cc-4f69-a83d-cd728f8322f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Acquiring lock "cinder-quobyte-c5490827-b7cc-4f69-a83d-cd728f8322f5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Lock "cinder-quobyte-c5490827-b7cc-4f69-a83d-cd728f8322f5" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a564dea6-7053-47bb-9a16-42dc6fddde9b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:38:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:34 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 Nov 03 18:38:34 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:34 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5" returned: 0 in 0.360s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:34 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5 Nov 03 18:38:34 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:34 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c5490827-b7cc-4f69-a83d-cd728f8322f5" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Lock "cinder-quobyte-c5490827-b7cc-4f69-a83d-cd728f8322f5" released by "delete_volume" :: held 0.677s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Created reservations ['9238f501-54e0-4f12-899f-ea3d71dc39ba', '43946df2-6662-4ee9-8faa-7ad999d22428', 'cf6e1095-89c3-4334-ab48-b52f1c66c56d', '03128ed8-3164-47ad-a24b-8f023d8c30b8'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:34 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:34 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:34 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Deleted volume successfully. Nov 03 18:38:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7c47ba06-2d09-406c-8c00-3e892e4f4acc tempest-TestMinimumBasicScenario-1731946379 None] Lock "cinder-c5490827-b7cc-4f69-a83d-cd728f8322f5-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:44 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:38:44 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (15c752f4-19b7-40ed-b6d2-099aa2c95477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd919caa-f074-45dd-b95f-cda2159c7921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd919caa-f074-45dd-b95f-cda2159c7921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576493924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7f992a-2793-4b05-8f2e-38143751209c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:50Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34396c82-e0ec-4a5b-881a-dba9d324c2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34396c82-e0ec-4a5b-881a-dba9d324c2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c60521-3117-445a-a0d6-3f8dff33ff54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c60521-3117-445a-a0d6-3f8dff33ff54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7f992a-2793-4b05-8f2e-38143751209c', 'volume_name': 'volume-5d7f992a-2793-4b05-8f2e-38143751209c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01025e71-d087-4072-9a4d-204f0160d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01025e71-d087-4072-9a4d-204f0160d713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73136e07-bc20-499e-98bc-f63e5954509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Volume 5d7f992a-2793-4b05-8f2e-38143751209c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7f992a-2793-4b05-8f2e-38143751209c', 'volume_size': 1} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-576493924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7f992a-2793-4b05-8f2e-38143751209c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:50Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Creating volume 5d7f992a-2793-4b05-8f2e-38143751209c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:38:49 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:49 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c 1073741824 Nov 03 18:38:49 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-7e122f88-8ebc-4bd2-83ab-aaf39a5af66d tempest-TestShelveInstance-1221162035 None] Terminate volume connection completed successfully. Nov 03 18:38:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-7e122f88-8ebc-4bd2-83ab-aaf39a5af66d tempest-TestShelveInstance-1221162035 None] Deleting attachment 857e3796-b8f0-40f7-bb98-a37012837ebb. {{(pid=86841) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Acquiring lock "cinder-edd215f8-a0b4-418b-8960-8de65be9428f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Lock "cinder-edd215f8-a0b4-418b-8960-8de65be9428f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (138d1796-a9c6-4cc2-a437-8df901f1e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c25897f-1bcb-4134-82e1-6b6b667a0bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Acquiring lock "cinder-quobyte-edd215f8-a0b4-418b-8960-8de65be9428f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c25897f-1bcb-4134-82e1-6b6b667a0bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1499818396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d957c80b-c987-4853-9fb0-690f5dd5ef9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:50Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9158cd-584f-4e9d-ba98-e7ffd7eba2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9158cd-584f-4e9d-ba98-e7ffd7eba2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a404b1d1-8f67-4291-930b-f3faffe79682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a404b1d1-8f67-4291-930b-f3faffe79682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd957c80b-c987-4853-9fb0-690f5dd5ef9f', 'volume_name': 'volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad031a-0266-4722-a530-998dbd332d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ad031a-0266-4722-a530-998dbd332d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a114aa9-9f4a-4eb9-aa37-7649a276dc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Volume d957c80b-c987-4853-9fb0-690f5dd5ef9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f', 'volume_size': 1} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Lock "cinder-quobyte-edd215f8-a0b4-418b-8960-8de65be9428f" acquired by "delete_volume" :: waited 0.064s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70ec2c9-aa29-46f2-aac6-be7dd374e5eb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:50 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c 1073741824" returned: 0 in 0.633s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:50 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c Nov 03 18:38:50 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:50 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f Nov 03 18:38:50 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (13d41659-3efb-4675-9cf6-2d0e092a699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ef2dc8-0da2-45f2-975e-0fe3b80db220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ef2dc8-0da2-45f2-975e-0fe3b80db220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1745959397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c88e90-0094-46c5-be42-d9bc43393629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:51Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85282392-9fdf-4ac6-8727-8f18227b4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85282392-9fdf-4ac6-8727-8f18227b4a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b776a748-c759-434f-9d46-cab9c56de283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b776a748-c759-434f-9d46-cab9c56de283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c88e90-0094-46c5-be42-d9bc43393629', 'volume_name': 'volume-56c88e90-0094-46c5-be42-d9bc43393629', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce76cbb-2525-4474-87d5-6b9ff8ee129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce76cbb-2525-4474-87d5-6b9ff8ee129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d16dbab-ecdc-496a-965b-e6aeeb1099fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Volume 56c88e90-0094-46c5-be42-d9bc43393629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c88e90-0094-46c5-be42-d9bc43393629', 'volume_size': 1} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:50 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f" returned: 0 in 0.591s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:50 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c" returned: 0 in 0.461s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:38:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:51 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f Nov 03 18:38:51 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1499818396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d957c80b-c987-4853-9fb0-690f5dd5ef9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:50Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Creating volume d957c80b-c987-4853-9fb0-690f5dd5ef9f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:38:51 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73136e07-bc20-499e-98bc-f63e5954509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7f992a-2793-4b05-8f2e-38143751209c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dcac63-3ffe-49ef-9f02-0986299fb041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Volume volume-5d7f992a-2793-4b05-8f2e-38143751209c (5d7f992a-2793-4b05-8f2e-38143751209c): created successfully Nov 03 18:38:51 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f 1073741824 Nov 03 18:38:51 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dcac63-3ffe-49ef-9f02-0986299fb041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (15c752f4-19b7-40ed-b6d2-099aa2c95477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (62efb60a-e5a5-43ff-abe7-8b278a109a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce0b7fd-199d-4e95-8ed9-714fb4b6674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-552b718e-faba-4297-a999-bf2ca5b5b1b9 tempest-CreateVolumesFromImageTest-1894568277 None] Created volume successfully. Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce0b7fd-199d-4e95-8ed9-714fb4b6674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-295337109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3355c56b-89bb-4557-a145-0e274e856e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:51Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e945f1-2b7a-4852-a7e1-7cf17764dc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e945f1-2b7a-4852-a7e1-7cf17764dc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df29589-63c8-4bc6-ae96-1e1d3cdbf6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df29589-63c8-4bc6-ae96-1e1d3cdbf6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3355c56b-89bb-4557-a145-0e274e856e63', 'volume_name': 'volume-3355c56b-89bb-4557-a145-0e274e856e63', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff89c4d-95c4-4bfa-bced-676f76cb4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff89c4d-95c4-4bfa-bced-676f76cb4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9957aa-6c6c-4701-9455-8b85163a166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Volume 3355c56b-89bb-4557-a145-0e274e856e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3355c56b-89bb-4557-a145-0e274e856e63', 'volume_size': 1} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:51 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-edd215f8-a0b4-418b-8960-8de65be9428f" returned: 0 in 0.335s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Lock "cinder-quobyte-edd215f8-a0b4-418b-8960-8de65be9428f" released by "delete_volume" :: held 0.996s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.quota [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Created reservations ['2d6716fc-584b-4d41-85e2-d301bc31bf4b', '1156706a-d0e3-4327-baf1-46d6a7e1b41a', '1e6d46f8-8267-4666-bdee-ca64435a60b0', 'f987d28d-d3ff-424a-aa2a-bc3e68347806'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:51 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:51 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (0cda5e01-8413-40fa-9cdb-0bdcb82051aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc00f75-bad5-49ea-be03-bfc2a3d7c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f 1073741824" returned: 0 in 0.746s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc00f75-bad5-49ea-be03-bfc2a3d7c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1961495135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3628eca4-9c96-46af-8cb2-ebb412a64584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:52Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c336ad-dea9-411f-ad70-6a6238550a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c336ad-dea9-411f-ad70-6a6238550a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9786766b-b706-45fe-9151-b93aa0b9da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9786766b-b706-45fe-9151-b93aa0b9da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3628eca4-9c96-46af-8cb2-ebb412a64584', 'volume_name': 'volume-3628eca4-9c96-46af-8cb2-ebb412a64584', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030cfd36-7854-4275-99f0-c159c4597f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030cfd36-7854-4275-99f0-c159c4597f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62320b2-ad76-4f2e-896f-cc2059642017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Volume 3628eca4-9c96-46af-8cb2-ebb412a64584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3628eca4-9c96-46af-8cb2-ebb412a64584', 'volume_size': 1} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:51 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.323s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.manager [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Deleted volume successfully. Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [req-ad8c1376-9d04-42fb-a005-3c9c90cfe3bd req-b5fccd82-4f9d-4913-b5d8-4f003a1372b3 tempest-TestShelveInstance-1221162035 None] Lock "cinder-edd215f8-a0b4-418b-8960-8de65be9428f-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:51 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f Nov 03 18:38:51 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:52 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f" returned: 0 in 0.246s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1745959397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c88e90-0094-46c5-be42-d9bc43393629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:51Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Creating volume 56c88e90-0094-46c5-be42-d9bc43393629 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:38:52 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a114aa9-9f4a-4eb9-aa37-7649a276dc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:52 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 1073741824 Nov 03 18:38:52 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0155f9-cefb-46b0-938c-828cb33ea2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Volume volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f (d957c80b-c987-4853-9fb0-690f5dd5ef9f): created successfully Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0155f9-cefb-46b0-938c-828cb33ea2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (138d1796-a9c6-4cc2-a437-8df901f1e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b7075f2c-0b20-4c44-b506-1b33c108cd17 tempest-CreateVolumesFromImageTest-1894568277 None] Created volume successfully. Nov 03 18:38:52 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 1073741824" returned: 0 in 0.499s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:52 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 Nov 03 18:38:52 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:52 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-295337109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3355c56b-89bb-4557-a145-0e274e856e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:51Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Creating volume 3355c56b-89bb-4557-a145-0e274e856e63 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:38:52 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d16dbab-ecdc-496a-965b-e6aeeb1099fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c88e90-0094-46c5-be42-d9bc43393629', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:52 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 1073741824 Nov 03 18:38:52 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a47c38-4ff5-4d92-98c9-a99d01dc0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Volume volume-56c88e90-0094-46c5-be42-d9bc43393629 (56c88e90-0094-46c5-be42-d9bc43393629): created successfully Nov 03 18:38:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a47c38-4ff5-4d92-98c9-a99d01dc0677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (13d41659-3efb-4675-9cf6-2d0e092a699c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:53 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2bf33cb4-39ed-472f-8abc-2b4e6badcc1a tempest-CreateVolumesFromImageTest-1894568277 None] Created volume successfully. Nov 03 18:38:53 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 1073741824" returned: 0 in 0.475s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:53 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 Nov 03 18:38:53 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:53 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63" returned: 0 in 0.271s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1961495135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3628eca4-9c96-46af-8cb2-ebb412a64584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ebe3f7c7a4228b29b39a33952d465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:38:52Z,use_quota=True,user_id='a408a19605a843808725912ce5dd712b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Creating volume 3628eca4-9c96-46af-8cb2-ebb412a64584 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:38:53 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9957aa-6c6c-4701-9455-8b85163a166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3355c56b-89bb-4557-a145-0e274e856e63', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:53 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 1073741824 Nov 03 18:38:53 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6af2b4-f0a5-4571-9520-e68fdbe09fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Volume volume-3355c56b-89bb-4557-a145-0e274e856e63 (3355c56b-89bb-4557-a145-0e274e856e63): created successfully Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6af2b4-f0a5-4571-9520-e68fdbe09fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (62efb60a-e5a5-43ff-abe7-8b278a109a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:53 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6e86ea41-d9b0-4e30-9306-fae3efe6e9cf tempest-CreateVolumesFromImageTest-1894568277 None] Created volume successfully. Nov 03 18:38:54 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 1073741824" returned: 0 in 0.513s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:54 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 Nov 03 18:38:54 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:54 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584" returned: 0 in 0.241s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62320b2-ad76-4f2e-896f-cc2059642017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3628eca4-9c96-46af-8cb2-ebb412a64584', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eae2a07-46df-413d-82a2-126fcd4ac52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:38:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Volume volume-3628eca4-9c96-46af-8cb2-ebb412a64584 (3628eca4-9c96-46af-8cb2-ebb412a64584): created successfully Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eae2a07-46df-413d-82a2-126fcd4ac52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:38:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Flow 'volume_create_manager' (0cda5e01-8413-40fa-9cdb-0bdcb82051aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:38:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0df29694-0c42-43e8-a7e4-7bfe6f88d18a tempest-CreateVolumesFromImageTest-1894568277 None] Created volume successfully. Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-3628eca4-9c96-46af-8cb2-ebb412a64584-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-3628eca4-9c96-46af-8cb2-ebb412a64584-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-quobyte-3628eca4-9c96-46af-8cb2-ebb412a64584" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-3628eca4-9c96-46af-8cb2-ebb412a64584" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e7828-6079-4128-9111-7f0052e27f93]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:55 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 Nov 03 18:38:55 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:55 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584" returned: 0 in 0.372s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:55 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584 Nov 03 18:38:55 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:55 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3628eca4-9c96-46af-8cb2-ebb412a64584" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-3628eca4-9c96-46af-8cb2-ebb412a64584" released by "delete_volume" :: held 0.710s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Created reservations ['0cc7e122-3495-4340-8d6d-59500353fee5', '5084f80c-d3a5-4314-b262-630ad5063a09', '27576f13-1f39-4650-b4c3-18b2da022e88', 'f8aca559-1c13-42ea-b8ed-bea97d73c890'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:56 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:56 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-3355c56b-89bb-4557-a145-0e274e856e63-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-3355c56b-89bb-4557-a145-0e274e856e63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:56 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-quobyte-3355c56b-89bb-4557-a145-0e274e856e63" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Deleted volume successfully. Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-3355c56b-89bb-4557-a145-0e274e856e63" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8faa44c6-cdc1-408e-9f15-3ab10836c4c8 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-3628eca4-9c96-46af-8cb2-ebb412a64584-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c70029-eed7-4c42-a27e-bd4bfaf979d9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:56 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 Nov 03 18:38:56 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:56 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:56 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63 Nov 03 18:38:56 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:57 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-3355c56b-89bb-4557-a145-0e274e856e63" returned: 0 in 0.257s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-3355c56b-89bb-4557-a145-0e274e856e63" released by "delete_volume" :: held 0.683s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Created reservations ['e2795360-f8a4-4e80-9a5b-21ec870a235c', 'f3575691-b56b-402f-9314-0716e3239810', '6a6aafe2-1274-4a43-973d-b2d61367249d', '61f5d837-696a-433b-9c5a-6513dfe6c21c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:57 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:57 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:57 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.276s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Deleted volume successfully. Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-02993610-b6d8-45d3-a9e7-195b04bf8bcf tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-3355c56b-89bb-4557-a145-0e274e856e63-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-56c88e90-0094-46c5-be42-d9bc43393629-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-56c88e90-0094-46c5-be42-d9bc43393629-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-quobyte-56c88e90-0094-46c5-be42-d9bc43393629" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-56c88e90-0094-46c5-be42-d9bc43393629" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c6a562-d6ee-43ec-a1ff-2a355bcab4c0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:38:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:57 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 Nov 03 18:38:57 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:58 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629" returned: 0 in 0.381s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:58 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629 Nov 03 18:38:58 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:58 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-56c88e90-0094-46c5-be42-d9bc43393629" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-56c88e90-0094-46c5-be42-d9bc43393629" released by "delete_volume" :: held 0.685s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Created reservations ['290f620c-398a-4c01-bd4a-fd982142ab7e', 'f8507af9-7f04-42d8-a0cb-51b07beb5a68', '5eeb3833-cec8-41c6-804f-3a117c818bdb', '10e59c86-a73c-4783-96dc-117f2b85086c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:58 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:58 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:58 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Deleted volume successfully. Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9875eaab-0d88-4eb8-a13f-44aee741e602 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-56c88e90-0094-46c5-be42-d9bc43393629-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-d957c80b-c987-4853-9fb0-690f5dd5ef9f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-d957c80b-c987-4853-9fb0-690f5dd5ef9f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-quobyte-d957c80b-c987-4853-9fb0-690f5dd5ef9f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-d957c80b-c987-4853-9fb0-690f5dd5ef9f" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5f1cf6-7bdb-4d84-9be5-853b36536a5b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:38:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:58 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f Nov 03 18:38:58 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:59 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f" returned: 0 in 0.401s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:59 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f Nov 03 18:38:59 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:59 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d957c80b-c987-4853-9fb0-690f5dd5ef9f" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-d957c80b-c987-4853-9fb0-690f5dd5ef9f" released by "delete_volume" :: held 0.691s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:59 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:59 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Created reservations ['68bba84d-5f1f-4ede-9e91-6e2fd339d016', 'ac72880b-1c29-4f3b-b52c-e9621ecb4b2f', '19a9b1cb-6cac-425a-b088-42045b107f6e', '7ad53049-21ae-4c3a-bb2b-dfd384e52c5d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:38:59 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:38:59 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:38:59 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.264s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-5d7f992a-2793-4b05-8f2e-38143751209c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-5d7f992a-2793-4b05-8f2e-38143751209c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:38:59 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.288s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:38:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:38:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Deleted volume successfully. Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-542e7491-72b9-43a6-a88b-7332f8a30fcd tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-d957c80b-c987-4853-9fb0-690f5dd5ef9f-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "cinder-quobyte-5d7f992a-2793-4b05-8f2e-38143751209c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-5d7f992a-2793-4b05-8f2e-38143751209c" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08209ae-f897-4166-8819-15b95a78bebc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:00 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c Nov 03 18:39:00 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:00 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c" returned: 0 in 0.408s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:00 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c Nov 03 18:39:00 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:00 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-5d7f992a-2793-4b05-8f2e-38143751209c" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-quobyte-5d7f992a-2793-4b05-8f2e-38143751209c" released by "delete_volume" :: held 0.724s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Created reservations ['6ba1e201-ab59-471d-8ea7-743d9b03d757', '204d40bc-9cac-4fb7-aa32-f82c6d55a7c0', '3eb19ade-42d8-4c26-aebf-bf635c35965d', '16d9f9ca-0fd4-4e80-8d5f-948b72b47590'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:00 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:00 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:01 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.278s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:01 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Deleted volume successfully. Nov 03 18:39:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-39fa0305-4815-4a17-b767-5e01ac5f9fd7 tempest-CreateVolumesFromImageTest-1894568277 None] Lock "cinder-5d7f992a-2793-4b05-8f2e-38143751209c-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (620ee610-7def-4c73-87cc-ac2fb342d8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c774d22-36f0-4156-b898-ea88a440403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c774d22-36f0-4156-b898-ea88a440403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018972375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54551db-3a14-4df5-a372-c9530cbea88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:05Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69c1a00-cffb-4572-a82b-3c20a72c70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69c1a00-cffb-4572-a82b-3c20a72c70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb728a4-9dbc-45ef-9a42-4a88611fb396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb728a4-9dbc-45ef-9a42-4a88611fb396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54551db-3a14-4df5-a372-c9530cbea88e', 'volume_name': 'volume-c54551db-3a14-4df5-a372-c9530cbea88e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d435b-985a-4537-974d-f41bdddff360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06d435b-985a-4537-974d-f41bdddff360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732cdf34-9666-4ebf-9659-1ff43e624177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume c54551db-3a14-4df5-a372-c9530cbea88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54551db-3a14-4df5-a372-c9530cbea88e', 'volume_size': 1} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2018972375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54551db-3a14-4df5-a372-c9530cbea88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:05Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating volume c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:04 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:04 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e 1073741824 Nov 03 18:39:04 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:05 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e 1073741824" returned: 0 in 0.500s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:05 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e Nov 03 18:39:05 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:05 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e" returned: 0 in 0.280s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732cdf34-9666-4ebf-9659-1ff43e624177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54551db-3a14-4df5-a372-c9530cbea88e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56443ce1-63f9-4129-ac73-bf205d06eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume volume-c54551db-3a14-4df5-a372-c9530cbea88e (c54551db-3a14-4df5-a372-c9530cbea88e): created successfully Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56443ce1-63f9-4129-ac73-bf205d06eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (620ee610-7def-4c73-87cc-ac2fb342d8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-62b500f0-eb98-4ffd-bc90-e6943f1a0414 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created volume successfully. Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating offline snapshot c05035ec-b368-4966-9c03-ddac20eba12d of volume c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6553957d-d9b4-4d91-8a0e-b1d810adaab3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:07 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e Nov 03 18:39:07 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:07 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e" returned: 0 in 0.401s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:07 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d 1G Nov 03 18:39:07 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:07 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d 1G" returned: 0 in 0.422s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c54551db-3a14-4df5-a372-c9530cbea88e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:07 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c54551db-3a14-4df5-a372-c9530cbea88e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d Nov 03 18:39:07 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:08 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c54551db-3a14-4df5-a372-c9530cbea88e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d" returned: 0 in 0.296s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:08 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d is being set with open permissions: ugo+rw Nov 03 18:39:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:08 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d Nov 03 18:39:08 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:08 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:08 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info Nov 03 18:39:08 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:08 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info" returned: 0 in 0.332s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:08 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info is being set with open permissions: ugo+rw Nov 03 18:39:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:08 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info Nov 03 18:39:08 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:09 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.info" returned: 0 in 0.272s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-58896fe4-1cdc-43ee-a4ab-704501b150d8 tempest-CreateVolumesFromSnapshotTest-933088665 None] Create snapshot completed successfully Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (1bab675e-6b4a-41f5-a3c0-54f7241b051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12da9edd-8289-459d-a114-f245e4bf86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12da9edd-8289-459d-a114-f245e4bf86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024555599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:11Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1c383b-8add-44a1-a376-c6d721e312a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1c383b-8add-44a1-a376-c6d721e312a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2f57fc-f199-4806-9c7b-88dd11b94426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2f57fc-f199-4806-9c7b-88dd11b94426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e', 'volume_name': 'volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c197e5aa-b994-4b18-b1a9-999bfa5560a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c197e5aa-b994-4b18-b1a9-999bfa5560a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7b5612-bee1-41eb-a045-aec0648bc28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e', 'volume_size': 1} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1024555599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:11Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating volume e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:10 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:10 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e 1073741824 Nov 03 18:39:10 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (a4a82627-a782-4dc0-85ec-3bb8684b7b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229ea0d2-777c-4540-b867-88aa9bd01253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229ea0d2-777c-4540-b867-88aa9bd01253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723909261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2eea60a-ca1e-4489-90cd-e87e5233e354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:11Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e894cad-88c5-4f4d-bd43-cd8b9508ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e894cad-88c5-4f4d-bd43-cd8b9508ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca98074b-9793-444d-abf5-ec16d86f59af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca98074b-9793-444d-abf5-ec16d86f59af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2eea60a-ca1e-4489-90cd-e87e5233e354', 'volume_name': 'volume-e2eea60a-ca1e-4489-90cd-e87e5233e354', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba90903-fc5e-44d5-91c7-69de20df5830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba90903-fc5e-44d5-91c7-69de20df5830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9daf0c7-1058-42d3-9f9f-793996e7ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume e2eea60a-ca1e-4489-90cd-e87e5233e354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2eea60a-ca1e-4489-90cd-e87e5233e354', 'volume_size': 1} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:11 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e 1073741824" returned: 0 in 0.672s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:11 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e Nov 03 18:39:11 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (154e67cb-f271-41ac-aae6-b3bca3eecb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1884ed-8606-4e40-a0a0-fab33a04a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1884ed-8606-4e40-a0a0-fab33a04a20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451609618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f88bf7-3bbe-414d-b0e5-46b6caa54553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:12Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30182eee-dd7f-42e3-922e-b420548b90c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30182eee-dd7f-42e3-922e-b420548b90c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d966da-248a-45d7-ab0d-fcad1ed4df23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d966da-248a-45d7-ab0d-fcad1ed4df23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f88bf7-3bbe-414d-b0e5-46b6caa54553', 'volume_name': 'volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b0bce8-dc83-4fae-8f0a-4038f617b314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b0bce8-dc83-4fae-8f0a-4038f617b314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1be008-e652-4643-9537-02900d025d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume c0f88bf7-3bbe-414d-b0e5-46b6caa54553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553', 'volume_size': 1} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:11 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723909261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2eea60a-ca1e-4489-90cd-e87e5233e354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:11Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating volume e2eea60a-ca1e-4489-90cd-e87e5233e354 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:11 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:11 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 1073741824 Nov 03 18:39:11 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7b5612-bee1-41eb-a045-aec0648bc28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a57011-feea-4bac-acf2-1a2b31fdbfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e (e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e): created successfully Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a57011-feea-4bac-acf2-1a2b31fdbfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (1bab675e-6b4a-41f5-a3c0-54f7241b051c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-de61ebad-4bea-4e93-889e-60ce096c63b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created volume successfully. Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (5612504a-f318-4c82-98bb-f384e93b5e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f3f026-e4e3-48b2-b748-81f182da8c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f3f026-e4e3-48b2-b748-81f182da8c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215022433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a03a078-f724-405b-b6a7-21b4700f53cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:12Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ef8a02-3224-4983-bfe2-b0a39b55562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ef8a02-3224-4983-bfe2-b0a39b55562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6506a5-8eea-41c8-8536-0aa0a81ee24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6506a5-8eea-41c8-8536-0aa0a81ee24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a03a078-f724-405b-b6a7-21b4700f53cd', 'volume_name': 'volume-0a03a078-f724-405b-b6a7-21b4700f53cd', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c77e2a0-9056-4212-9dfa-2360847afe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c77e2a0-9056-4212-9dfa-2360847afe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72e3e80-5947-46c3-8fc6-fdc2103fdbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume 0a03a078-f724-405b-b6a7-21b4700f53cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a03a078-f724-405b-b6a7-21b4700f53cd', 'volume_size': 1} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:12 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 1073741824" returned: 0 in 0.630s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:12 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 Nov 03 18:39:12 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (ca8bd941-ca80-43fd-9790-349c13eb2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5991261c-c253-4a28-9670-3bdc3b020358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5991261c-c253-4a28-9670-3bdc3b020358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025206243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac559ca-9122-40bc-af23-97fd0283dca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:13Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fb0ad7-3f2e-41e7-8852-bf832db46ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66fb0ad7-3f2e-41e7-8852-bf832db46ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5f1316-a7e5-49d8-8a67-40cb19eabf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5f1316-a7e5-49d8-8a67-40cb19eabf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac559ca-9122-40bc-af23-97fd0283dca5', 'volume_name': 'volume-0ac559ca-9122-40bc-af23-97fd0283dca5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12401e23-acf9-4fd8-8378-87764c9a02b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12401e23-acf9-4fd8-8378-87764c9a02b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5a734f-ea7f-4152-85b3-1eb3b699ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume 0ac559ca-9122-40bc-af23-97fd0283dca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac559ca-9122-40bc-af23-97fd0283dca5', 'volume_size': 1} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:12 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354" returned: 0 in 0.272s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451609618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f88bf7-3bbe-414d-b0e5-46b6caa54553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:12Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating volume c0f88bf7-3bbe-414d-b0e5-46b6caa54553 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:12 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9daf0c7-1058-42d3-9f9f-793996e7ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2eea60a-ca1e-4489-90cd-e87e5233e354', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 1073741824 Nov 03 18:39:12 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a337b9-cbe2-4fba-b10b-746e93bdf56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 (e2eea60a-ca1e-4489-90cd-e87e5233e354): created successfully Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a337b9-cbe2-4fba-b10b-746e93bdf56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (a4a82627-a782-4dc0-85ec-3bb8684b7b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-96f7a3e9-58a8-4149-b686-8a9d1b926322 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created volume successfully. Nov 03 18:39:13 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 1073741824" returned: 0 in 0.478s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:13 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 Nov 03 18:39:13 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:13 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215022433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a03a078-f724-405b-b6a7-21b4700f53cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:12Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating volume 0a03a078-f724-405b-b6a7-21b4700f53cd {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:13 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1be008-e652-4643-9537-02900d025d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1c93a5-59f5-4d2c-a829-7162bc6dc2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:13 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd 1073741824 Nov 03 18:39:13 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 (c0f88bf7-3bbe-414d-b0e5-46b6caa54553): created successfully Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1c93a5-59f5-4d2c-a829-7162bc6dc2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (154e67cb-f271-41ac-aae6-b3bca3eecb7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9af16f0d-d9e1-4a6b-a430-6acb5c8d4fac tempest-CreateVolumesFromSnapshotTest-933088665 None] Created volume successfully. Nov 03 18:39:14 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd 1073741824" returned: 0 in 0.539s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:14 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd Nov 03 18:39:14 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:14 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.801s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2025206243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac559ca-9122-40bc-af23-97fd0283dca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59007650b984ab5887b849e1fc78569',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:13Z,use_quota=True,user_id='ebb743e0b4334903ad344e5d3329baa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Creating volume 0ac559ca-9122-40bc-af23-97fd0283dca5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:14 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:14 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 1073741824 Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72e3e80-5947-46c3-8fc6-fdc2103fdbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a03a078-f724-405b-b6a7-21b4700f53cd', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:14 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4eb995-fdbd-4334-bb9b-80026bbf0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume volume-0a03a078-f724-405b-b6a7-21b4700f53cd (0a03a078-f724-405b-b6a7-21b4700f53cd): created successfully Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4eb995-fdbd-4334-bb9b-80026bbf0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (5612504a-f318-4c82-98bb-f384e93b5e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-07542834-9dfc-4862-95d2-42d3350938b0 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created volume successfully. Nov 03 18:39:15 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 1073741824" returned: 0 in 0.526s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:15 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 Nov 03 18:39:15 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:15 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5a734f-ea7f-4152-85b3-1eb3b699ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac559ca-9122-40bc-af23-97fd0283dca5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7af5fa-4283-4953-8adc-58cea220e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:15 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Volume volume-0ac559ca-9122-40bc-af23-97fd0283dca5 (0ac559ca-9122-40bc-af23-97fd0283dca5): created successfully Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e7af5fa-4283-4953-8adc-58cea220e627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:15 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Flow 'volume_create_manager' (ca8bd941-ca80-43fd-9790-349c13eb2019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b7d8ba35-9006-439f-a74e-a07c9408ff29 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created volume successfully. Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-0ac559ca-9122-40bc-af23-97fd0283dca5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-0ac559ca-9122-40bc-af23-97fd0283dca5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-0ac559ca-9122-40bc-af23-97fd0283dca5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-0ac559ca-9122-40bc-af23-97fd0283dca5" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adc2217-5a58-4030-b54c-566f1264799e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:16 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 Nov 03 18:39:16 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:16 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5" returned: 0 in 0.373s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:16 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5 Nov 03 18:39:16 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:16 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0ac559ca-9122-40bc-af23-97fd0283dca5" returned: 0 in 0.300s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-0ac559ca-9122-40bc-af23-97fd0283dca5" released by "delete_volume" :: held 0.721s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['9ce32fc8-eb21-41d5-9d60-3c46edfb8ff0', '0806e2c6-c910-4cd8-85c1-fd55fe873735', '9af95c25-a17c-4edf-ae96-34bc60ee9b13', 'e9e7c00f-3c12-44a5-a8e9-0044896ead88'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:16 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:16 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-0a03a078-f724-405b-b6a7-21b4700f53cd-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:17 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-0a03a078-f724-405b-b6a7-21b4700f53cd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.272s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleted volume successfully. Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8be89480-f48d-451b-b5dc-bd7b8c3144dd tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-0ac559ca-9122-40bc-af23-97fd0283dca5-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-0a03a078-f724-405b-b6a7-21b4700f53cd" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-0a03a078-f724-405b-b6a7-21b4700f53cd" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f7cb6-a30d-4009-be9a-722a8c4326af]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:17 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd Nov 03 18:39:17 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:17 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd" returned: 0 in 0.387s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:17 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd Nov 03 18:39:17 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:17 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0a03a078-f724-405b-b6a7-21b4700f53cd" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-0a03a078-f724-405b-b6a7-21b4700f53cd" released by "delete_volume" :: held 0.682s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['212e1e8f-f439-4be1-b4d0-0124e99df2f5', '6f797240-6686-4f85-a0d6-05334e2a8279', '72bb162b-7b79-4745-b9da-dbef39de93de', '20a5ee90-b9fd-440c-88ed-ef838298f25a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:18 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:18 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-c0f88bf7-3bbe-414d-b0e5-46b6caa54553-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:18 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.283s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:18 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleted volume successfully. Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-c0f88bf7-3bbe-414d-b0e5-46b6caa54553-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5a36d2a-78ab-4677-9c09-39d2df05b58b tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-0a03a078-f724-405b-b6a7-21b4700f53cd-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-c0f88bf7-3bbe-414d-b0e5-46b6caa54553" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c0f88bf7-3bbe-414d-b0e5-46b6caa54553" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a963b-01dd-464f-8618-c7f6773f277a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:18 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 Nov 03 18:39:18 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:18 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553" returned: 0 in 0.414s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:18 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553 Nov 03 18:39:18 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:19 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c0f88bf7-3bbe-414d-b0e5-46b6caa54553" returned: 0 in 0.248s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c0f88bf7-3bbe-414d-b0e5-46b6caa54553" released by "delete_volume" :: held 0.714s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['666533ff-5067-4b6a-b543-71872db69226', 'e90ea5fd-09e1-4d73-9bce-7ab13a14e547', '31658c76-ea31-4df9-a606-d8f33a7da8a2', '4558d375-92a6-40fb-9d9c-9354e1ef914b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:19 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:19 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-e2eea60a-ca1e-4489-90cd-e87e5233e354-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-e2eea60a-ca1e-4489-90cd-e87e5233e354-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-e2eea60a-ca1e-4489-90cd-e87e5233e354" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-e2eea60a-ca1e-4489-90cd-e87e5233e354" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a18705-7c1b-4fa5-9710-bdaaf65c7ecc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:19 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.405s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:19 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleted volume successfully. Nov 03 18:39:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-122d5891-95eb-4151-8960-7d128504b920 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-c0f88bf7-3bbe-414d-b0e5-46b6caa54553-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:19 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 Nov 03 18:39:19 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:20 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354" returned: 0 in 0.406s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:20 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354 Nov 03 18:39:20 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:20 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2eea60a-ca1e-4489-90cd-e87e5233e354" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-e2eea60a-ca1e-4489-90cd-e87e5233e354" released by "delete_volume" :: held 0.729s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['7e9457b7-ce2a-4eba-babd-ecf106a7dbba', '735702ea-84ad-4ffd-9c20-301786ed06df', 'bebca2be-f4a2-46bd-ba37-069199585189', 'dd4b9640-2607-47c1-892c-47219173b539'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:20 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:20 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:20 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleted volume successfully. Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-efa05ddc-ae48-45bb-952c-0a042d5ec201 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-e2eea60a-ca1e-4489-90cd-e87e5233e354-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3783329f-f01c-4d58-b655-2bdbe137227b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:21 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e Nov 03 18:39:21 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:21 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e" returned: 0 in 0.363s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:21 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e Nov 03 18:39:21 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:21 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e" released by "delete_volume" :: held 0.676s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['2d2e0c2a-1ce6-4d1a-995c-fd7d1421dbf9', '6359022e-987a-425e-946f-7058c155a841', '97a3e50a-9222-4e80-bf80-150401d256f1', '49afaf16-0d81-4f55-b350-2900bae58330'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:21 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:21 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-c05035ec-b368-4966-9c03-ddac20eba12d-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-c05035ec-b368-4966-9c03-ddac20eba12d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-c54551db-3a14-4df5-a372-c9530cbea88e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c54551db-3a14-4df5-a372-c9530cbea88e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-c05035ec-b368-4966-9c03-ddac20eba12d" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:22 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.329s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c05035ec-b368-4966-9c03-ddac20eba12d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleting offline snapshot c05035ec-b368-4966-9c03-ddac20eba12d of volume c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] snapshot_file for this snap is: volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:39:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleted volume successfully. Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d5e655-15c9-490b-9a3d-d6642a20f444]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-779e4f52-a2b3-454b-b111-113deb68b8fb tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-e0efebb1-ba37-4dbc-97c9-e5e9f0b9bc6e-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:22 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d Nov 03 18:39:22 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:22 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d" returned: 0 in 0.364s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c54551db-3a14-4df5-a372-c9530cbea88e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af26a40-e317-4c1e-824e-99c3b28cb610]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:22 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e Nov 03 18:39:22 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:22 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e" returned: 0 in 0.346s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:22 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d Nov 03 18:39:22 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:23 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:23 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d Nov 03 18:39:23 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:23 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e.c05035ec-b368-4966-9c03-ddac20eba12d" returned: 0 in 0.253s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c05035ec-b368-4966-9c03-ddac20eba12d" released by "_delete_snapshot" :: held 1.443s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c54551db-3a14-4df5-a372-c9530cbea88e" released by "delete_snapshot" :: held 1.480s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['45170466-758d-40e1-9708-e678fc26c8c6', 'adc48706-3397-4935-ab83-64e46c1d21b1', '3bcebedb-ce3d-434a-adf9-a485db9ed938', 'bcfa2a6a-cbb6-4205-84b6-9c6f18bac1bb'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Delete snapshot completed successfully. Nov 03 18:39:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ade15627-efd9-4a91-b6fc-48283e8e2aa5 tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-c05035ec-b368-4966-9c03-ddac20eba12d-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-c54551db-3a14-4df5-a372-c9530cbea88e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-c54551db-3a14-4df5-a372-c9530cbea88e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "cinder-quobyte-c54551db-3a14-4df5-a372-c9530cbea88e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c54551db-3a14-4df5-a372-c9530cbea88e" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[21788ea2-b572-4a3b-9902-d7a482082d27]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:24 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e Nov 03 18:39:24 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:24 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e" returned: 0 in 0.385s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:24 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e Nov 03 18:39:24 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:24 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c54551db-3a14-4df5-a372-c9530cbea88e" returned: 0 in 0.293s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-quobyte-c54551db-3a14-4df5-a372-c9530cbea88e" released by "delete_volume" :: held 0.753s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Created reservations ['40aea2f1-678e-45ff-99df-78a5fe8a90c2', '3ece99b0-55f4-453d-8aab-34168ac45b07', 'c5bcd3f2-3555-42e7-9afa-689c5d4caf4e', '7a07bc61-d4b1-4ab3-b683-1e77c8568411'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:25 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:25 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:25 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Deleted volume successfully. Nov 03 18:39:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-81406fc1-8e26-46ef-b02f-6fea123a7dea tempest-CreateVolumesFromSnapshotTest-933088665 None] Lock "cinder-c54551db-3a14-4df5-a372-c9530cbea88e-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Flow 'volume_create_manager' (741cd10a-418e-4716-a0c7-576ff6671804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14046fa7-a575-49fe-8aff-e756f794d57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14046fa7-a575-49fe-8aff-e756f794d57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-510558274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b545be6b-cf59-4115-8bfd-492ea40efe92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7d1eab8e5740b19cc6c2dfb18f8430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:27Z,use_quota=True,user_id='105a8aabb4494e60833360e52480f883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017939ff-6102-4360-8551-eee8f827725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017939ff-6102-4360-8551-eee8f827725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb833630-6444-47b6-90de-101b2d76b8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb833630-6444-47b6-90de-101b2d76b8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b545be6b-cf59-4115-8bfd-492ea40efe92', 'volume_name': 'volume-b545be6b-cf59-4115-8bfd-492ea40efe92', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8003bba-7f81-4b4d-ac4a-5f87f3e75e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8003bba-7f81-4b4d-ac4a-5f87f3e75e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8fe189-4d84-4c73-820c-cb83ecd8a0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:26 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Volume b545be6b-cf59-4115-8bfd-492ea40efe92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b545be6b-cf59-4115-8bfd-492ea40efe92', 'volume_size': 1} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-510558274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b545be6b-cf59-4115-8bfd-492ea40efe92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b7d1eab8e5740b19cc6c2dfb18f8430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:27Z,use_quota=True,user_id='105a8aabb4494e60833360e52480f883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Creating volume b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:26 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:26 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 1073741824 Nov 03 18:39:26 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:27 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 1073741824" returned: 0 in 0.457s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:27 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 Nov 03 18:39:27 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:27 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8fe189-4d84-4c73-820c-cb83ecd8a0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b545be6b-cf59-4115-8bfd-492ea40efe92', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8f32cd-95aa-4cf7-8ef1-20fbcfd6bbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:27 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Volume volume-b545be6b-cf59-4115-8bfd-492ea40efe92 (b545be6b-cf59-4115-8bfd-492ea40efe92): created successfully Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8f32cd-95aa-4cf7-8ef1-20fbcfd6bbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Flow 'volume_create_manager' (741cd10a-418e-4716-a0c7-576ff6671804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2c1442f1-47f6-4a9d-a926-f3f78e356a7c tempest-TestImageHashVerification-102610408 None] Created volume successfully. Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Flow 'volume_create_manager' (91ea80a2-302f-43e5-9ca3-2faefb5253cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cec866-e765-48da-b253-c8601f572ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27cec866-e765-48da-b253-c8601f572ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82112d4a-4dd0-4819-83bc-f3f6a7261291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f507c9ad817142e8ae3b044e13fbd47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:28Z,use_quota=True,user_id='47705819151748ad867d375feb3feb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a322f9e3-e873-4190-80a2-bb978e7944e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a322f9e3-e873-4190-80a2-bb978e7944e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea6ed3c-04e1-4c5e-8b14-545c2515ba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea6ed3c-04e1-4c5e-8b14-545c2515ba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82112d4a-4dd0-4819-83bc-f3f6a7261291', 'volume_name': 'volume-82112d4a-4dd0-4819-83bc-f3f6a7261291', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab9bb9e-2a04-4d06-8fe4-8a8eda695a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab9bb9e-2a04-4d06-8fe4-8a8eda695a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6fd5b2-8ece-458d-855d-52d28430a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:28 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Volume 82112d4a-4dd0-4819-83bc-f3f6a7261291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82112d4a-4dd0-4819-83bc-f3f6a7261291', 'volume_size': 1} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82112d4a-4dd0-4819-83bc-f3f6a7261291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f507c9ad817142e8ae3b044e13fbd47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:28Z,use_quota=True,user_id='47705819151748ad867d375feb3feb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Creating volume 82112d4a-4dd0-4819-83bc-f3f6a7261291 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:28 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:28 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 1073741824 Nov 03 18:39:28 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:28 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 1073741824" returned: 0 in 0.435s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:28 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 Nov 03 18:39:28 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:29 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6fd5b2-8ece-458d-855d-52d28430a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82112d4a-4dd0-4819-83bc-f3f6a7261291', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccd232c-35aa-4083-8bd0-fb18fbe05e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Volume volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 (82112d4a-4dd0-4819-83bc-f3f6a7261291): created successfully Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bccd232c-35aa-4083-8bd0-fb18fbe05e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Flow 'volume_create_manager' (91ea80a2-302f-43e5-9ca3-2faefb5253cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d1d04575-2066-4bcc-b338-520d04288186 tempest-CinderUnicodeTest-1797131548 None] Created volume successfully. Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[745bf8ed-7fbf-4084-9fa3-618e2ee7dd40]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Flow 'volume_create_manager' (c113e2ff-8b77-4db9-a907-2c0bd52ec90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142f2d6d-f48b-4348-8b4c-14aac7bc7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142f2d6d-f48b-4348-8b4c-14aac7bc7af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1897683251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968a46e8-e335-402c-8c06-7408b27e18df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f507c9ad817142e8ae3b044e13fbd47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:30Z,use_quota=True,user_id='47705819151748ad867d375feb3feb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:29 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 Nov 03 18:39:29 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43da2b71-da68-4be6-b933-2cbada7be9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43da2b71-da68-4be6-b933-2cbada7be9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94783461-b182-45b9-b923-3031eb404696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94783461-b182-45b9-b923-3031eb404696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968a46e8-e335-402c-8c06-7408b27e18df', 'volume_name': 'volume-968a46e8-e335-402c-8c06-7408b27e18df', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87e886a-d464-48c3-ad9d-0dfc67b750b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87e886a-d464-48c3-ad9d-0dfc67b750b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63076dd2-1ed4-4620-9d15-c6dcca6a9c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:30 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Volume 968a46e8-e335-402c-8c06-7408b27e18df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968a46e8-e335-402c-8c06-7408b27e18df', 'volume_size': 1} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:30 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92" returned: 0 in 0.358s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1f1881-57a3-44b5-b84c-b5e6604a5f03]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:30 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 Nov 03 18:39:30 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:30 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 /opt/stack/data/cinder/conversion/b545be6b-cf59-4115-8bfd-492ea40efe92.temp_image.b289a27c-43c2-4f01-9022-766e53edefebarc79ua9.img {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:30 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 /opt/stack/data/cinder/conversion/b545be6b-cf59-4115-8bfd-492ea40efe92.temp_image.b289a27c-43c2-4f01-9022-766e53edefebarc79ua9.img Nov 03 18:39:30 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:36 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 /opt/stack/data/cinder/conversion/b545be6b-cf59-4115-8bfd-492ea40efe92.temp_image.b289a27c-43c2-4f01-9022-766e53edefebarc79ua9.img" returned: 0 in 5.602s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[07748a9f-a8d0-4ca5-9269-38b966439606]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:36 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 Nov 03 18:39:36 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:36 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92" returned: 0 in 0.517s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:36 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/conversion/b545be6b-cf59-4115-8bfd-492ea40efe92.temp_image.b289a27c-43c2-4f01-9022-766e53edefebarc79ua9.img {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:39:36 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Converted 1024.00 MB image at 182.76 MB/s Nov 03 18:39:36 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] b289a27c-43c2-4f01-9022-766e53edefeb was raw, no need to convert to raw {{(pid=86841) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 03 18:39:39 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=89,cinder:UPDATE=148,cinder:DELETE=12,cinder:INSERT=33 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:39:46 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=138,cinder:SELECT=109,cinder:INSERT=33,cinder:DELETE=14 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Uploaded volume to glance image-id: b289a27c-43c2-4f01-9022-766e53edefeb. {{(pid=86841) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.865s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:39:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1897683251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968a46e8-e335-402c-8c06-7408b27e18df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f507c9ad817142e8ae3b044e13fbd47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:39:30Z,use_quota=True,user_id='47705819151748ad867d375feb3feb6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Creating volume 968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:39:54 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:39:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9b904640-f411-467f-9095-aace27af51a3 tempest-TestImageHashVerification-102610408 None] Copy volume to image completed successfully. Nov 03 18:39:54 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df 1073741824 Nov 03 18:39:54 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:55 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df 1073741824" returned: 0 in 0.411s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:55 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df Nov 03 18:39:55 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:55 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df" returned: 0 in 0.253s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63076dd2-1ed4-4620-9d15-c6dcca6a9c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968a46e8-e335-402c-8c06-7408b27e18df', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcc7fb3-61fb-49b3-8d0d-d6e720ba9b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:39:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Volume volume-968a46e8-e335-402c-8c06-7408b27e18df (968a46e8-e335-402c-8c06-7408b27e18df): created successfully Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcc7fb3-61fb-49b3-8d0d-d6e720ba9b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:39:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Flow 'volume_create_manager' (c113e2ff-8b77-4db9-a907-2c0bd52ec90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:39:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c61639c9-f398-45ab-bb71-1755084c4657 tempest-CinderUnicodeTest-1797131548 None] Created volume successfully. Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Acquiring lock "cinder-b545be6b-cf59-4115-8bfd-492ea40efe92-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Lock "cinder-b545be6b-cf59-4115-8bfd-492ea40efe92-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Acquiring lock "cinder-quobyte-b545be6b-cf59-4115-8bfd-492ea40efe92" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Lock "cinder-quobyte-b545be6b-cf59-4115-8bfd-492ea40efe92" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e76ae90-8bfc-4a0b-ade6-3782ef16aaa7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:56 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 Nov 03 18:39:56 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:56 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92" returned: 0 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:56 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92 Nov 03 18:39:56 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Creating offline snapshot 5b450199-be6b-402e-8b5a-3082feb45791 of volume 968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c72278-c1c9-414c-902b-3b5a82752e7e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:57 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df Nov 03 18:39:57 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:57 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b545be6b-cf59-4115-8bfd-492ea40efe92" returned: 0 in 0.279s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Lock "cinder-quobyte-b545be6b-cf59-4115-8bfd-492ea40efe92" released by "delete_volume" :: held 0.738s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Created reservations ['76d2406c-a1e0-4aad-9cb0-337305cd6898', '6f61914c-1621-4dbb-9e91-63c8eb99c43a', '84f219b7-d9a7-48e7-8f14-8e406e1ba73d', 'cbac8b80-3b29-4ae3-9839-2eb1ec0f8bd0'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:57 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:57 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:57 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df" returned: 0 in 0.367s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:57 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 1G Nov 03 18:39:57 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:57 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.285s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Deleted volume successfully. Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8ec61c1f-c763-4eaa-a9eb-4ff3f4a2f973 tempest-TestImageHashVerification-102610408 None] Lock "cinder-b545be6b-cf59-4115-8bfd-492ea40efe92-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:39:57 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 1G" returned: 0 in 0.462s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968a46e8-e335-402c-8c06-7408b27e18df -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:57 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968a46e8-e335-402c-8c06-7408b27e18df -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 Nov 03 18:39:57 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:58 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968a46e8-e335-402c-8c06-7408b27e18df -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791" returned: 0 in 0.319s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:58 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 is being set with open permissions: ugo+rw Nov 03 18:39:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:58 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 Nov 03 18:39:58 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:58 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791" returned: 0 in 0.273s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:58 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info Nov 03 18:39:58 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:58 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info" returned: 0 in 0.257s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:58 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info is being set with open permissions: ugo+rw Nov 03 18:39:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:58 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info Nov 03 18:39:58 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:59 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.info" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cceb8536-045a-4bcc-8668-9c57892372c6 tempest-CinderUnicodeTest-1797131548 None] Create snapshot completed successfully Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:39:59 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:39:59 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:39:59 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:39:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-5b450199-be6b-402e-8b5a-3082feb45791-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-5b450199-be6b-402e-8b5a-3082feb45791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-quobyte-968a46e8-e335-402c-8c06-7408b27e18df" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-968a46e8-e335-402c-8c06-7408b27e18df" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-quobyte-5b450199-be6b-402e-8b5a-3082feb45791" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-5b450199-be6b-402e-8b5a-3082feb45791" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Deleting offline snapshot 5b450199-be6b-402e-8b5a-3082feb45791 of volume 968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] snapshot_file for this snap is: volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18951a-47de-4a85-a5ed-64201119d35a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:00 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 Nov 03 18:40:00 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:00 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-968a46e8-e335-402c-8c06-7408b27e18df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8e317-7664-40fc-8fa2-dd3a33a957af]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:00 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df Nov 03 18:40:00 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:01 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df" returned: 0 in 0.401s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:01 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 Nov 03 18:40:01 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:01 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:01 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791 Nov 03 18:40:01 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:01 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df.5b450199-be6b-402e-8b5a-3082feb45791" returned: 0 in 0.310s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-5b450199-be6b-402e-8b5a-3082feb45791" released by "_delete_snapshot" :: held 1.510s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-968a46e8-e335-402c-8c06-7408b27e18df" released by "delete_snapshot" :: held 1.536s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Created reservations ['257cd8ab-f549-48b2-aa03-2279ad58a418', '072d9739-86a4-40b9-8c41-24cf881eb8c9', 'aef2fc93-2fa8-4134-8c4c-2f676bbaf34d', 'bee7629e-8793-42ca-a740-d0a79340b882'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Delete snapshot completed successfully. Nov 03 18:40:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8eae8424-fed4-42d6-b661-18c41918beb3 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-5b450199-be6b-402e-8b5a-3082feb45791-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-968a46e8-e335-402c-8c06-7408b27e18df-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-968a46e8-e335-402c-8c06-7408b27e18df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-quobyte-968a46e8-e335-402c-8c06-7408b27e18df" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-968a46e8-e335-402c-8c06-7408b27e18df" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a554be3-61dc-4e7b-badf-eed6dffe6112]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:02 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df Nov 03 18:40:02 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:02 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df" returned: 0 in 0.390s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:02 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df Nov 03 18:40:02 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:03 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-968a46e8-e335-402c-8c06-7408b27e18df" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-968a46e8-e335-402c-8c06-7408b27e18df" released by "delete_volume" :: held 0.735s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Created reservations ['bbe73a90-1d53-42fa-8807-b08df32bbaf4', '8a059c10-8f81-4bc9-a507-1fc5f1797eca', 'e143ffcf-134d-4419-ace6-19693729bd38', '14a9e74f-018c-4d86-bab1-b496ebe8ecf2'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:03 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:03 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-82112d4a-4dd0-4819-83bc-f3f6a7261291-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-82112d4a-4dd0-4819-83bc-f3f6a7261291-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:03 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.273s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Deleted volume successfully. Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "cinder-quobyte-82112d4a-4dd0-4819-83bc-f3f6a7261291" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-82112d4a-4dd0-4819-83bc-f3f6a7261291" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cac7f324-da57-4e5b-bc64-74fb33ef064d tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-968a46e8-e335-402c-8c06-7408b27e18df-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7ced51-49e0-4fd5-b5cb-d15a794b5452]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:03 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 Nov 03 18:40:03 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:04 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291" returned: 0 in 0.389s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:04 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291 Nov 03 18:40:04 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:04 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-82112d4a-4dd0-4819-83bc-f3f6a7261291" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-quobyte-82112d4a-4dd0-4819-83bc-f3f6a7261291" released by "delete_volume" :: held 0.695s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Created reservations ['09b9d373-a934-4198-bb00-97dd4edc2a2e', '4dd83fe6-45ff-428d-80a9-7fd0bd392bfd', 'feaaf773-da30-4984-88bf-394632968117', '72363e46-0fa4-4333-8940-b83661f3d5d6'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:04 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:04 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:04 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.244s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Deleted volume successfully. Nov 03 18:40:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-0a24234d-707c-4e75-a9d2-25d177d15df6 tempest-CinderUnicodeTest-1797131548 None] Lock "cinder-82112d4a-4dd0-4819-83bc-f3f6a7261291-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Flow 'volume_create_manager' (9fc5debf-cac3-4995-9fe2-6bdd06af978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30debf88-a5b8-41b5-9037-f2a6c1573624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30debf88-a5b8-41b5-9037-f2a6c1573624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089166785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d186ec8-7ea5-4392-bb20-f172b7ceed4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182f2d70fc104eb3933393161e28bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:09Z,use_quota=True,user_id='575c227ac48c4173b6358012ccdbcdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ee8240-fe6b-429e-88d8-9efa24eeb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ee8240-fe6b-429e-88d8-9efa24eeb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3d079b-6644-418c-9a61-ecf2438cf3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3d079b-6644-418c-9a61-ecf2438cf3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d186ec8-7ea5-4392-bb20-f172b7ceed4b', 'volume_name': 'volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964b621f-fb34-4c99-a4ae-d169ebcb929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964b621f-fb34-4c99-a4ae-d169ebcb929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f22d677-c748-4654-b6e2-8d95f225f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:09 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Volume 6d186ec8-7ea5-4392-bb20-f172b7ceed4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b', 'volume_size': 1} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2089166785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d186ec8-7ea5-4392-bb20-f172b7ceed4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182f2d70fc104eb3933393161e28bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:09Z,use_quota=True,user_id='575c227ac48c4173b6358012ccdbcdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Creating volume 6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:09 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:09 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b 1073741824 Nov 03 18:40:09 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:10 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b 1073741824" returned: 0 in 0.451s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:10 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b Nov 03 18:40:10 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:10 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f22d677-c748-4654-b6e2-8d95f225f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98461e7-c388-43f5-8c9e-112c365ebfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Volume volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b (6d186ec8-7ea5-4392-bb20-f172b7ceed4b): created successfully Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98461e7-c388-43f5-8c9e-112c365ebfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Flow 'volume_create_manager' (9fc5debf-cac3-4995-9fe2-6bdd06af978e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ea538859-a4f0-4479-869b-8d7daf959506 tempest-VolumeDependencyTests-1727328711 None] Created volume successfully. Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Creating offline snapshot 7354dce4-449d-4a50-83a2-b5d626a7c277 of volume 6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf0ad22-36c4-48d5-819f-cd62bdfed20f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:10 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b Nov 03 18:40:10 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:11 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" returned: 0 in 0.375s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:11 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 1G Nov 03 18:40:11 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:11 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 1G" returned: 0 in 0.376s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:11 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 Nov 03 18:40:11 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:11 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:11 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 is being set with open permissions: ugo+rw Nov 03 18:40:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:11 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 Nov 03 18:40:11 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:12 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:12 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info Nov 03 18:40:12 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:12 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info" returned: 0 in 0.244s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:12 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info is being set with open permissions: ugo+rw Nov 03 18:40:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:12 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info Nov 03 18:40:12 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:12 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.info" returned: 0 in 0.245s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0e966f26-8c89-4ce4-8349-ed4c28b6fe3c tempest-VolumeDependencyTests-1727328711 None] Create snapshot completed successfully Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Flow 'volume_create_manager' (29ad92a0-559d-4aba-a4ca-fa22d39b141a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e010f8f8-68e3-4047-8d00-715391db0e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e010f8f8-68e3-4047-8d00-715391db0e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1495361397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdafd932-a876-4729-82e9-332f1ae399b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182f2d70fc104eb3933393161e28bb46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7354dce4-449d-4a50-83a2-b5d626a7c277,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:13Z,use_quota=True,user_id='575c227ac48c4173b6358012ccdbcdb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6af694b-dab0-4c97-bf0c-471150cf99fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6af694b-dab0-4c97-bf0c-471150cf99fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f30722a-7132-44bb-be0d-5d598f30fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f30722a-7132-44bb-be0d-5d598f30fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cdafd932-a876-4729-82e9-332f1ae399b7', 'volume_name': 'volume-cdafd932-a876-4729-82e9-332f1ae399b7', 'volume_size': 1, 'snapshot_id': '7354dce4-449d-4a50-83a2-b5d626a7c277'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915d5d5e-2349-4f49-829c-967a415a7f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (915d5d5e-2349-4f49-829c-967a415a7f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636154d1-54a2-4d7a-bf37-29a80be609b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Volume cdafd932-a876-4729-82e9-332f1ae399b7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cdafd932-a876-4729-82e9-332f1ae399b7', 'volume_size': 1, 'snapshot_id': '7354dce4-449d-4a50-83a2-b5d626a7c277'} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-quobyte-7354dce4-449d-4a50-83a2-b5d626a7c277-cdafd932-a876-4729-82e9-332f1ae399b7" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-7354dce4-449d-4a50-83a2-b5d626a7c277-cdafd932-a876-4729-82e9-332f1ae399b7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Creating volume cdafd932-a876-4729-82e9-332f1ae399b7 from snapshot 7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-quobyte-cdafd932-a876-4729-82e9-332f1ae399b7" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-cdafd932-a876-4729-82e9-332f1ae399b7" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] snapshot: 7354dce4-449d-4a50-83a2-b5d626a7c277, volume: cdafd932-a876-4729-82e9-332f1ae399b7, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d6ef7-b23b-448f-9025-567497528414]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:13 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 Nov 03 18:40:13 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:13 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277" returned: 0 in 0.346s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ba3f33-a55c-4869-882e-17c98dae8472]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:13 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b Nov 03 18:40:13 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:14 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" returned: 0 in 0.345s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:40:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:40:14 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:40:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:14 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 Nov 03 18:40:14 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:19 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7" returned: 0 in 5.688s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:19 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:40:19 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Converted 1024.00 MB image at 179.98 MB/s Nov 03 18:40:19 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 is being set with open permissions: ugo+rw Nov 03 18:40:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:19 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 Nov 03 18:40:19 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:20 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7" returned: 0 in 0.235s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-cdafd932-a876-4729-82e9-332f1ae399b7" released by "_copy_volume_from_snapshot" :: held 6.694s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-7354dce4-449d-4a50-83a2-b5d626a7c277-cdafd932-a876-4729-82e9-332f1ae399b7" released by "_create_volume_from_snapshot" :: held 6.752s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.766s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636154d1-54a2-4d7a-bf37-29a80be609b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdafd932-a876-4729-82e9-332f1ae399b7', 'volume_size': 1, 'snapshot_id': '7354dce4-449d-4a50-83a2-b5d626a7c277'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c239e9-2c0b-42ad-b676-d54865573303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Volume volume-cdafd932-a876-4729-82e9-332f1ae399b7 (cdafd932-a876-4729-82e9-332f1ae399b7): created successfully Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c239e9-2c0b-42ad-b676-d54865573303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Flow 'volume_create_manager' (29ad92a0-559d-4aba-a4ca-fa22d39b141a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a838dd63-312d-449c-8cbb-68125023dacb tempest-VolumeDependencyTests-1727328711 None] Created volume successfully. Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-7354dce4-449d-4a50-83a2-b5d626a7c277-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-7354dce4-449d-4a50-83a2-b5d626a7c277-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-quobyte-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-quobyte-7354dce4-449d-4a50-83a2-b5d626a7c277" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-7354dce4-449d-4a50-83a2-b5d626a7c277" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Deleting offline snapshot 7354dce4-449d-4a50-83a2-b5d626a7c277 of volume 6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] snapshot_file for this snap is: volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad166360-12f5-45d5-9b87-da07b9bce075]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:20 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 Nov 03 18:40:20 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:21 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277" returned: 0 in 0.355s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:40:21 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdab92d-71a4-4329-b5f7-6ae0f3f80741]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:21 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b Nov 03 18:40:21 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:21 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" returned: 0 in 0.515s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:21 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 Nov 03 18:40:21 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:22 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277" returned: 0 in 0.309s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:22 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277 Nov 03 18:40:22 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:22 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b.7354dce4-449d-4a50-83a2-b5d626a7c277" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-7354dce4-449d-4a50-83a2-b5d626a7c277" released by "_delete_snapshot" :: held 1.511s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" released by "delete_snapshot" :: held 1.532s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Created reservations ['a9eb326e-f25a-4c75-b7c0-49994e0ee878', '9e268a5b-f9fc-41a8-bef6-325e81a2a9d6', '743ea024-7062-4b13-8a5f-4ede3bbf9efb', '5b1b8485-55bf-41da-b01e-6c0f40071ab2'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Delete snapshot completed successfully. Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-351dd1eb-1980-4feb-b7fa-44453b19d686 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-7354dce4-449d-4a50-83a2-b5d626a7c277-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-6d186ec8-7ea5-4392-bb20-f172b7ceed4b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-6d186ec8-7ea5-4392-bb20-f172b7ceed4b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-quobyte-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:22 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948bfdd-11f8-4400-b316-911350e0053f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:23 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b Nov 03 18:40:23 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:23 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:23 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b Nov 03 18:40:23 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:23 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" returned: 0 in 0.241s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-6d186ec8-7ea5-4392-bb20-f172b7ceed4b" released by "delete_volume" :: held 0.651s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Created reservations ['ffc410f8-d895-4578-97df-ded9c1cd6b90', '2596b133-bca5-4ceb-8519-c1856ec0173b', '4b40c1bb-a036-4023-909d-0969834d7762', 'cf82e099-5965-4ce1-a6bf-a2a06c592dba'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:23 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:23 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:23 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.233s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Deleted volume successfully. Nov 03 18:40:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c45a0db5-3a30-448d-b485-81c1926d88b4 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-6d186ec8-7ea5-4392-bb20-f172b7ceed4b-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-cdafd932-a876-4729-82e9-332f1ae399b7-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-cdafd932-a876-4729-82e9-332f1ae399b7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "cinder-quobyte-cdafd932-a876-4729-82e9-332f1ae399b7" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-cdafd932-a876-4729-82e9-332f1ae399b7" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b68352-2b53-481f-93e1-e6cb2b06499a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:24 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 Nov 03 18:40:24 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:24 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:24 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7 Nov 03 18:40:24 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:24 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cdafd932-a876-4729-82e9-332f1ae399b7" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-quobyte-cdafd932-a876-4729-82e9-332f1ae399b7" released by "delete_volume" :: held 0.623s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Created reservations ['a52dfebc-fcb0-4228-802f-ab150dfe55c0', '07ba9929-9d03-40a0-b5a4-33d8bce17286', '64198b17-0620-4c13-8bed-eafe2232dbd7', '8efe784f-13a7-4647-a9df-def6e5d43bb4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:24 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:24 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:25 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.242s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:25 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Deleted volume successfully. Nov 03 18:40:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7030aaa5-3eb0-4c95-afec-c6f8cf2864d6 tempest-VolumeDependencyTests-1727328711 None] Lock "cinder-cdafd932-a876-4729-82e9-332f1ae399b7-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Flow 'volume_create_manager' (11e757e3-22f3-489d-9611-c48b52594a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c50c3ce-a9ca-4fd3-ab4e-3d06ad545dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c50c3ce-a9ca-4fd3-ab4e-3d06ad545dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048333008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c89d95a-fb21-4ccd-b2ac-9018d3767d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dc1bf2fa7c4225bf9eb6701aa6e7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:28Z,use_quota=True,user_id='79599c96e936481d8831f4252b8c0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f4458a-7cbf-4601-87e7-caa4c988405f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f4458a-7cbf-4601-87e7-caa4c988405f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce97605c-137b-4dd4-aa28-2db620d6ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce97605c-137b-4dd4-aa28-2db620d6ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c89d95a-fb21-4ccd-b2ac-9018d3767d1b', 'volume_name': 'volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8af5d6f-8482-420a-8207-6f898b3e6b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8af5d6f-8482-420a-8207-6f898b3e6b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761fc4af-b929-438c-9f5b-19994f65357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:28 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Volume 6c89d95a-fb21-4ccd-b2ac-9018d3767d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b', 'volume_size': 1} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048333008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c89d95a-fb21-4ccd-b2ac-9018d3767d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dc1bf2fa7c4225bf9eb6701aa6e7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:28Z,use_quota=True,user_id='79599c96e936481d8831f4252b8c0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Creating volume 6c89d95a-fb21-4ccd-b2ac-9018d3767d1b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:28 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:28 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b 1073741824 Nov 03 18:40:28 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:28 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b 1073741824" returned: 0 in 0.405s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:28 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b Nov 03 18:40:28 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:29 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b" returned: 0 in 0.242s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761fc4af-b929-438c-9f5b-19994f65357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1d7b6c-4ad1-4981-a61c-d9448189c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:29 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Volume volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b (6c89d95a-fb21-4ccd-b2ac-9018d3767d1b): created successfully Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1d7b6c-4ad1-4981-a61c-d9448189c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Flow 'volume_create_manager' (11e757e3-22f3-489d-9611-c48b52594a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9ab8d8a3-3466-406d-9653-e7a15c62c8a2 tempest-ProjectReaderTests-1624209528 None] Created volume successfully. Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Acquiring lock "cinder-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Lock "cinder-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Acquiring lock "cinder-quobyte-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Lock "cinder-quobyte-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4422ddd-c938-48bb-a36a-97572034c27c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:29 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b Nov 03 18:40:29 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:29 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b" returned: 0 in 0.358s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:30 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b Nov 03 18:40:30 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:30 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b" returned: 0 in 0.243s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Lock "cinder-quobyte-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b" released by "delete_volume" :: held 0.640s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Created reservations ['341f9765-496d-4b86-8825-2a8ec7215813', '07fb5fa5-ccb7-47a9-b7d5-a84659900762', '4f50d330-d364-462e-b95f-5dce6f84ea55', 'e09fe8d8-8877-43e0-9bce-c2c387c93932'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:30 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:30 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:30 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Deleted volume successfully. Nov 03 18:40:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-71b93647-ba87-42ef-a032-f4f3221422fb tempest-ProjectReaderTests-1624209528 None] Lock "cinder-6c89d95a-fb21-4ccd-b2ac-9018d3767d1b-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Flow 'volume_create_manager' (86d90ce6-d446-4f7b-a05d-7733df8ae366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1d39a2-2cca-40dc-83c0-105d3961966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1d39a2-2cca-40dc-83c0-105d3961966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045877797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a37cf0-d78c-4c4a-a6ca-2102e1172c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dc1bf2fa7c4225bf9eb6701aa6e7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:31Z,use_quota=True,user_id='79599c96e936481d8831f4252b8c0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63100839-cdf4-4a2d-92e4-631f7adb7146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63100839-cdf4-4a2d-92e4-631f7adb7146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e53ed6-0028-458e-9274-585f32234449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e53ed6-0028-458e-9274-585f32234449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2a37cf0-d78c-4c4a-a6ca-2102e1172c80', 'volume_name': 'volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6eaef93-5833-472d-855a-f5a5037a83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6eaef93-5833-472d-855a-f5a5037a83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f601a1-6ef9-49e2-ad4b-63ad5315bf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:31 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Volume e2a37cf0-d78c-4c4a-a6ca-2102e1172c80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80', 'volume_size': 1} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045877797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2a37cf0-d78c-4c4a-a6ca-2102e1172c80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dc1bf2fa7c4225bf9eb6701aa6e7a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:31Z,use_quota=True,user_id='79599c96e936481d8831f4252b8c0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Creating volume e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:31 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:31 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 1073741824 Nov 03 18:40:31 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:31 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 1073741824" returned: 0 in 0.405s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:31 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 Nov 03 18:40:31 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:31 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80" returned: 0 in 0.241s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f601a1-6ef9-49e2-ad4b-63ad5315bf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea61cb9-3183-46e9-bafe-0a86c84aacf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:31 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Volume volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 (e2a37cf0-d78c-4c4a-a6ca-2102e1172c80): created successfully Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea61cb9-3183-46e9-bafe-0a86c84aacf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Flow 'volume_create_manager' (86d90ce6-d446-4f7b-a05d-7733df8ae366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a8ef409e-eddd-428e-91d5-12509ff49b4b tempest-ProjectReaderTests-1624209528 None] Created volume successfully. Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Acquiring lock "cinder-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Lock "cinder-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Acquiring lock "cinder-quobyte-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Lock "cinder-quobyte-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80" acquired by "delete_volume" :: waited 0.012s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42655f0-2329-46e9-b6c9-cd5d6ea6b22e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:32 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 Nov 03 18:40:32 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:32 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80" returned: 0 in 0.354s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:32 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80 Nov 03 18:40:32 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:32 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80" returned: 0 in 0.246s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Lock "cinder-quobyte-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80" released by "delete_volume" :: held 0.637s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Created reservations ['fd099916-b40d-411a-90d0-9383be10b2d1', '01839cca-e1c7-4778-9fc4-b6bc66bf1957', 'e756e892-d06d-4aba-958f-b21cd57761cc', '9f01b199-3cc3-40cf-8096-6d3243ae0975'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:33 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:33 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:33 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.234s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:33 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Deleted volume successfully. Nov 03 18:40:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-92ca39b4-4cd9-441f-b59a-77a7962d28c3 tempest-ProjectReaderTests-1624209528 None] Lock "cinder-e2a37cf0-d78c-4c4a-a6ca-2102e1172c80-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:42 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=65,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:40:43 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=63,cinder:INSERT=23,cinder:UPDATE=87,cinder:DELETE=9 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (db0d6b1c-c8b0-4fa4-b140-f7925256d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3801929b-d409-4a9a-ae3b-fcb648190130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3801929b-d409-4a9a-ae3b-fcb648190130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461059025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f05e731-2ab8-4a4d-a442-67428de6d3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abdcb8f-dbf2-4985-9467-0ff78cfc549c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abdcb8f-dbf2-4985-9467-0ff78cfc549c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953a163-82d6-4d17-87c7-0f06d802769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c953a163-82d6-4d17-87c7-0f06d802769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f05e731-2ab8-4a4d-a442-67428de6d3e5', 'volume_name': 'volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34482882-6788-48b4-a134-52cf63cf216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34482882-6788-48b4-a134-52cf63cf216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae0ed97-225b-47b4-8453-0de38d3fe772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:45 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Volume 8f05e731-2ab8-4a4d-a442-67428de6d3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5', 'volume_size': 1} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-461059025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f05e731-2ab8-4a4d-a442-67428de6d3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Creating volume 8f05e731-2ab8-4a4d-a442-67428de6d3e5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:45 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:45 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 1073741824 Nov 03 18:40:45 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (f0753f10-272a-4448-91d0-c112645b9a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c47be9f-618e-4033-b283-b8d2349f02f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c47be9f-618e-4033-b283-b8d2349f02f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455102048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1e5c8c-c278-4c28-8883-544caeff376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563b89ed-60ff-48af-83cc-9232afef261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563b89ed-60ff-48af-83cc-9232afef261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f6ad5a-5821-4c2e-96a1-105e83fffdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f6ad5a-5821-4c2e-96a1-105e83fffdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1e5c8c-c278-4c28-8883-544caeff376f', 'volume_name': 'volume-cb1e5c8c-c278-4c28-8883-544caeff376f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5fcabe-a6ba-431e-a783-6c8017078080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5fcabe-a6ba-431e-a783-6c8017078080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b814ee2-a8ca-4bae-95e7-07f5b82c8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume cb1e5c8c-c278-4c28-8883-544caeff376f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1e5c8c-c278-4c28-8883-544caeff376f', 'volume_size': 1} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (c791dd05-9cf3-4f32-9658-8b5af711f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b261de1-79e8-4acc-811c-7edc0fc910d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b261de1-79e8-4acc-811c-7edc0fc910d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304393366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0b39ef-d13f-4623-a1af-be47cda76e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a913ce7c-af6d-45ad-a4ae-db3ff019f4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a913ce7c-af6d-45ad-a4ae-db3ff019f4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040ea439-3503-44e6-98e3-d05e76142e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040ea439-3503-44e6-98e3-d05e76142e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e0b39ef-d13f-4623-a1af-be47cda76e96', 'volume_name': 'volume-2e0b39ef-d13f-4623-a1af-be47cda76e96', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084c95f9-0438-4b34-8a15-57d9b4f7d3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084c95f9-0438-4b34-8a15-57d9b4f7d3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fc7ce6-e6c5-493b-9df8-4a238bd0a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Volume 2e0b39ef-d13f-4623-a1af-be47cda76e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e0b39ef-d13f-4623-a1af-be47cda76e96', 'volume_size': 1} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 1073741824" returned: 0 in 0.783s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (6b3ae1f5-dd9a-494b-b359-d5da4f9c2dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c6f7a0-b512-4c44-a60f-06f7022b7f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90c6f7a0-b512-4c44-a60f-06f7022b7f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017744447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81a0050-5e41-46a4-ba33-119ffe997fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67dfb7a-9189-4d52-a61b-b86a47f5a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67dfb7a-9189-4d52-a61b-b86a47f5a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497bd661-d759-460d-89a6-d73fa47e2d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497bd661-d759-460d-89a6-d73fa47e2d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81a0050-5e41-46a4-ba33-119ffe997fae', 'volume_name': 'volume-d81a0050-5e41-46a4-ba33-119ffe997fae', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7f994c-8049-4325-af55-2b76e3f8142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7f994c-8049-4325-af55-2b76e3f8142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ce46bd-fc7f-44fd-8c2e-0ef252c5dee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:46 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume d81a0050-5e41-46a4-ba33-119ffe997fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81a0050-5e41-46a4-ba33-119ffe997fae', 'volume_size': 1} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:46 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 Nov 03 18:40:46 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:46 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (f6d8ef21-1903-4a56-a1ad-af3a382d9f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:47 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736cab34-a005-4264-a1d7-6987eee0bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5" returned: 0 in 0.311s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455102048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1e5c8c-c278-4c28-8883-544caeff376f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating volume cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736cab34-a005-4264-a1d7-6987eee0bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-429034408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8983ee5-9087-4535-b542-124f9939ff7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:47Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d438e446-3788-4f5b-9d51-053233b619a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f 1073741824 Nov 03 18:40:47 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d438e446-3788-4f5b-9d51-053233b619a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea0466b-9e30-475a-9e82-ae97f2e14030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea0466b-9e30-475a-9e82-ae97f2e14030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8983ee5-9087-4535-b542-124f9939ff7f', 'volume_name': 'volume-d8983ee5-9087-4535-b542-124f9939ff7f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8233548-0e9a-4673-b5e4-820faa6844eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8233548-0e9a-4673-b5e4-820faa6844eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69b054d-4b39-4dd0-a7bf-7c016396858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Volume d8983ee5-9087-4535-b542-124f9939ff7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8983ee5-9087-4535-b542-124f9939ff7f', 'volume_size': 1} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae0ed97-225b-47b4-8453-0de38d3fe772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd07683-f586-44f1-ba45-abe8771a792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (5eaed298-db41-44a9-9df8-c689417d7a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faef16b-d34c-41dd-aeee-0a890f9ccbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Volume volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 (8f05e731-2ab8-4a4d-a442-67428de6d3e5): created successfully Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd07683-f586-44f1-ba45-abe8771a792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (db0d6b1c-c8b0-4fa4-b140-f7925256d418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5faef16b-d34c-41dd-aeee-0a890f9ccbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-793536514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff36438d-b8de-47bc-b5bb-c4c529691ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:47Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c667ae92-458e-4190-87c8-a32f61b8f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c667ae92-458e-4190-87c8-a32f61b8f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18594c46-951b-4cba-ba11-53541c05b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18594c46-951b-4cba-ba11-53541c05b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff36438d-b8de-47bc-b5bb-c4c529691ac0', 'volume_name': 'volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3bc565-0f59-4549-b7a0-6722ff13ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3bc565-0f59-4549-b7a0-6722ff13ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b3c0c7-3b02-4d29-8e15-a69a62c2c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Volume ff36438d-b8de-47bc-b5bb-c4c529691ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0', 'volume_size': 1} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-78916f34-2a6f-47cc-b3be-b6d3f719454e tempest-CreateVolumesFromImageTest-102020439 None] Created volume successfully. Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (4714f272-36aa-4444-8cf0-745728340f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fefdb6-c7cd-4447-802a-af8fe02fe7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2fefdb6-c7cd-4447-802a-af8fe02fe7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932781098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b000a70-d752-4280-8824-af4704b13897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:47Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6929185f-4c02-43b2-83af-1d2f747d596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6929185f-4c02-43b2-83af-1d2f747d596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7b418c-519a-4f9f-b66c-f61ebf7200a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7b418c-519a-4f9f-b66c-f61ebf7200a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b000a70-d752-4280-8824-af4704b13897', 'volume_name': 'volume-8b000a70-d752-4280-8824-af4704b13897', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99d3f84-193b-4e7d-a48d-f96b262182f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99d3f84-193b-4e7d-a48d-f96b262182f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddaa01d-4306-41e5-946c-e412f5d91133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Volume 8b000a70-d752-4280-8824-af4704b13897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b000a70-d752-4280-8824-af4704b13897', 'volume_size': 1} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:47 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f 1073741824" returned: 0 in 0.501s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:47 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f Nov 03 18:40:47 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:47 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.270s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-304393366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e0b39ef-d13f-4623-a1af-be47cda76e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Creating volume 2e0b39ef-d13f-4623-a1af-be47cda76e96 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b814ee2-a8ca-4bae-95e7-07f5b82c8150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1e5c8c-c278-4c28-8883-544caeff376f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 1073741824 Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c1d772-bff0-4957-a8f0-cc25e722fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:47 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume volume-cb1e5c8c-c278-4c28-8883-544caeff376f (cb1e5c8c-c278-4c28-8883-544caeff376f): created successfully Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c1d772-bff0-4957-a8f0-cc25e722fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:47 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (f0753f10-272a-4448-91d0-c112645b9a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-76a2a62f-43a2-4d17-9925-88e6733889ce tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created volume successfully. Nov 03 18:40:48 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 1073741824" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:48 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 Nov 03 18:40:48 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:48 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017744447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81a0050-5e41-46a4-ba33-119ffe997fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:46Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Creating volume d81a0050-5e41-46a4-ba33-119ffe997fae {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:48 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:48 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae 1073741824 Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fc7ce6-e6c5-493b-9df8-4a238bd0a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e0b39ef-d13f-4623-a1af-be47cda76e96', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:48 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4221f8ab-37c6-45f7-b265-e202e04c57bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:48 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Volume volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 (2e0b39ef-d13f-4623-a1af-be47cda76e96): created successfully Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4221f8ab-37c6-45f7-b265-e202e04c57bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (c791dd05-9cf3-4f32-9658-8b5af711f087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7ed4a500-cc49-4588-a9a2-db43fb1c857e tempest-CreateVolumesFromImageTest-102020439 None] Created volume successfully. Nov 03 18:40:49 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae 1073741824" returned: 0 in 0.514s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:49 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae Nov 03 18:40:49 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:49 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae" returned: 0 in 0.264s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.296s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-429034408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8983ee5-9087-4535-b542-124f9939ff7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:47Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Creating volume d8983ee5-9087-4535-b542-124f9939ff7f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:49 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:49 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f 1073741824 Nov 03 18:40:49 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ce46bd-fc7f-44fd-8c2e-0ef252c5dee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81a0050-5e41-46a4-ba33-119ffe997fae', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53f85fc-e3bd-41b2-8ebb-de8e19f5cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume volume-d81a0050-5e41-46a4-ba33-119ffe997fae (d81a0050-5e41-46a4-ba33-119ffe997fae): created successfully Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53f85fc-e3bd-41b2-8ebb-de8e19f5cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (6b3ae1f5-dd9a-494b-b359-d5da4f9c2dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1ac2da10-b413-4a62-9053-e6a01fa3e8a9 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created volume successfully. Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Flow 'volume_create_manager' (bc13d3eb-4c6a-4184-a965-351dd55f2485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e057b035-50db-4bcb-9932-6854f9e78be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e057b035-50db-4bcb-9932-6854f9e78be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0c2791-748c-4987-a114-af78108a112f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c29c872ea740f8b4bdf02650eaf9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:50Z,use_quota=True,user_id='9bb21a37247045e98af8c62605d347bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f30f90d-a20f-4d8b-a318-fb4bd071e8d2),volume_type_id=4f30f90d-a20f-4d8b-a318-fb4bd071e8d2)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f687764-4122-4913-ac62-905f9bbe0a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f687764-4122-4913-ac62-905f9bbe0a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7627c808-aeaf-44a7-a19c-1c97d92358ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:40:49 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f 1073741824" returned: 0 in 0.481s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:50 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f Nov 03 18:40:50 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7627c808-aeaf-44a7-a19c-1c97d92358ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b0c2791-748c-4987-a114-af78108a112f', 'volume_name': 'volume-9b0c2791-748c-4987-a114-af78108a112f', 'volume_size': 1, 'image_id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11380af-54cd-4850-9752-ac17cc9eba0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c347b306da27bd29d4271a4ec4856f04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e7c29c872ea740f8b4bdf02650eaf9ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6f53ff215ada3812ec112169c8f815158c3a19a1be509b823ebd0e2966b324bf0c06d201bdce4683b46ef774e20d1f6cfbc84e2b46f408c70c289a8fbd6e5724', 'id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'created_at': datetime.datetime(2026, 11, 3, 17, 40, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 40, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11380af-54cd-4850-9752-ac17cc9eba0c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7a3ec6-1d00-47eb-827b-ff7dc7977e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7a3ec6-1d00-47eb-827b-ff7dc7977e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7467006b-b1ad-4641-86b8-1360ddbd944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Volume 9b0c2791-748c-4987-a114-af78108a112f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b0c2791-748c-4987-a114-af78108a112f', 'volume_size': 1, 'image_id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11380af-54cd-4850-9752-ac17cc9eba0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c347b306da27bd29d4271a4ec4856f04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e7c29c872ea740f8b4bdf02650eaf9ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6f53ff215ada3812ec112169c8f815158c3a19a1be509b823ebd0e2966b324bf0c06d201bdce4683b46ef774e20d1f6cfbc84e2b46f408c70c289a8fbd6e5724', 'id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'created_at': datetime.datetime(2026, 11, 3, 17, 40, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 40, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11380af-54cd-4850-9752-ac17cc9eba0c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Trying to clone 9b0c2791-748c-4987-a114-af78108a112f from image c11380af-54cd-4850-9752-ac17cc9eba0c at location (None, [{'url': 'file:///opt/stack/data/glance/images/c11380af-54cd-4850-9752-ac17cc9eba0c', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:40:50 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Image download 0.00 MB at 0.00 MB/s Nov 03 18:40:50 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.890s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-793536514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff36438d-b8de-47bc-b5bb-c4c529691ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:47Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Creating volume ff36438d-b8de-47bc-b5bb-c4c529691ac0 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:50 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:50 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 1073741824 Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69b054d-4b39-4dd0-a7bf-7c016396858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8983ee5-9087-4535-b542-124f9939ff7f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:50 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c48cf4-d9b9-414a-9283-33327fa0ff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa64dfeb-a5cb-4a45-8fc3-dcf567c7f63e]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:50 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Volume volume-d8983ee5-9087-4535-b542-124f9939ff7f (d8983ee5-9087-4535-b542-124f9939ff7f): created successfully Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c48cf4-d9b9-414a-9283-33327fa0ff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (f6d8ef21-1903-4a56-a1ad-af3a382d9f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:50 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4e2784c1-1d1a-45de-bcbf-eb5c03387464 tempest-CreateVolumesFromImageTest-102020439 None] Created volume successfully. Nov 03 18:40:50 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD Nov 03 18:40:50 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:50 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:50 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 1073741824" returned: 0 in 0.562s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:50 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 Nov 03 18:40:50 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:50 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD Nov 03 18:40:50 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (9f0aeb43-4e5e-4c1b-ac7f-1f5cb116eb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f3a56c-cf69-4c48-91c2-d833b4575459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f3a56c-cf69-4c48-91c2-d833b4575459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779721393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a73bd0-de1a-4ccf-ba96-44b39d971a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:51Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21477412-e1db-423c-bde1-b22d8f08a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21477412-e1db-423c-bde1-b22d8f08a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b006c9c-8146-4035-a9e6-19c8217cea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b006c9c-8146-4035-a9e6-19c8217cea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77a73bd0-de1a-4ccf-ba96-44b39d971a31', 'volume_name': 'volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7aa42b-cdcc-46e0-97d9-00bf5d7edfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7aa42b-cdcc-46e0-97d9-00bf5d7edfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cc6970-7ced-469f-99ac-7790991a4d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume 77a73bd0-de1a-4ccf-ba96-44b39d971a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31', 'volume_size': 1} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0" returned: 0 in 0.357s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.734s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932781098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b000a70-d752-4280-8824-af4704b13897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f04aea34d3349d1ba7f31a22b285b31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:47Z,use_quota=True,user_id='2acb098f592d45fca4b44a9de86b28c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Creating volume 8b000a70-d752-4280-8824-af4704b13897 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:51 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Temporary image c11380af-54cd-4850-9752-ac17cc9eba0c is fetched for user 9bb21a37247045e98af8c62605d347bb. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b3c0c7-3b02-4d29-8e15-a69a62c2c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4463bf0b-1f3f-4805-93c7-d8b4ecb60a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 1073741824 Nov 03 18:40:51 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Volume volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 (ff36438d-b8de-47bc-b5bb-c4c529691ac0): created successfully Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4463bf0b-1f3f-4805-93c7-d8b4ecb60a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (5eaed298-db41-44a9-9df8-c689417d7a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4869e2d0-43d4-4d26-91f1-517fe40046e2 tempest-CreateVolumesFromImageTest-102020439 None] Created volume successfully. Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e992c3-b955-44d3-9e1c-f42bee723290]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:51 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD Nov 03 18:40:51 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (6aee4b53-9a5f-42d8-8e62-15ec16c7fb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482b8b59-3652-405a-9e71-4239abdb2b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482b8b59-3652-405a-9e71-4239abdb2b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161468061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576337ac-a6f3-4e1f-b570-92f00fc21733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:51Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466cb2c-63be-4fac-b2e8-72f16ae9210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7466cb2c-63be-4fac-b2e8-72f16ae9210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf0c7a8-8404-4227-9726-b1faa0ee0ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf0c7a8-8404-4227-9726-b1faa0ee0ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576337ac-a6f3-4e1f-b570-92f00fc21733', 'volume_name': 'volume-576337ac-a6f3-4e1f-b570-92f00fc21733', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4e5613-d024-41df-9572-4428139dba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4e5613-d024-41df-9572-4428139dba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14338dea-f3d5-4d4d-b275-3c5890543822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:51 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume 576337ac-a6f3-4e1f-b570-92f00fc21733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576337ac-a6f3-4e1f-b570-92f00fc21733', 'volume_size': 1} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:51 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:51 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 1073741824" returned: 0 in 0.585s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:51 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 Nov 03 18:40:51 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (dc090670-5e9f-4329-9085-f9cb155533c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:51 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f73894d-578a-4d5d-8bf7-e83e055bcb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD Nov 03 18:40:52 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f73894d-578a-4d5d-8bf7-e83e055bcb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439074551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e9c38f-950c-4e83-8b7d-8b8f676ee155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:52Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbca93f-23e4-4421-8267-0a6a3bd272df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edbca93f-23e4-4421-8267-0a6a3bd272df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bfe2da-c08d-4c98-a391-b12b42011949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bfe2da-c08d-4c98-a391-b12b42011949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e9c38f-950c-4e83-8b7d-8b8f676ee155', 'volume_name': 'volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f273f9a0-58f2-4991-837c-9c512d38183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f273f9a0-58f2-4991-837c-9c512d38183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644462aa-ec0a-4199-9860-998c46e06591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume b4e9c38f-950c-4e83-8b7d-8b8f676ee155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155', 'volume_size': 1} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:52 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897" returned: 0 in 0.314s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.993s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating offline snapshot 2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 of volume cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddaa01d-4306-41e5-946c-e412f5d91133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b000a70-d752-4280-8824-af4704b13897', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f224c3-0c2a-4295-87fb-6009e5753d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6eb3da-c206-4b7f-a1c1-a34dd5799a43]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Volume volume-8b000a70-d752-4280-8824-af4704b13897 (8b000a70-d752-4280-8824-af4704b13897): created successfully Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f224c3-0c2a-4295-87fb-6009e5753d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Flow 'volume_create_manager' (4714f272-36aa-4444-8cf0-745728340f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:52 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4165d102-f1cf-4569-a6da-788fd16c21d3 tempest-CreateVolumesFromImageTest-102020439 None] Created volume successfully. Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:52 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (2acb0e16-6683-4b13-b1cf-8ab2c8ab9e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:52 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d6890d-a1e3-495d-93d2-569a332ec4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d6890d-a1e3-495d-93d2-569a332ec4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031919357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fbc670-fe74-4e91-82ed-b21abd15b39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:52Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec5dec3-2978-4efe-9c59-42b99d79b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec5dec3-2978-4efe-9c59-42b99d79b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ca38b-4a42-41f3-ab1d-7661983b73ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ca38b-4a42-41f3-ab1d-7661983b73ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fbc670-fe74-4e91-82ed-b21abd15b39d', 'volume_name': 'volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c7dcf4-69ed-4db4-adf2-1ad10af560a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c7dcf4-69ed-4db4-adf2-1ad10af560a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c461ff96-2529-4251-a05b-4291e7fc8659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume e2fbc670-fe74-4e91-82ed-b21abd15b39d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d', 'volume_size': 1} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:52 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f" returned: 0 in 0.435s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:52 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 1G Nov 03 18:40:52 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (c77d6e19-4925-43a9-bcb6-4fce9c14229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f51cff3-3178-4a46-81ec-11a5394a5752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f51cff3-3178-4a46-81ec-11a5394a5752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984827490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c57bb2-5794-4aab-be47-2dcb31f6d71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:53Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea4991f-c195-41c0-a940-68042949f566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aea4991f-c195-41c0-a940-68042949f566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686a11fa-112b-4bc2-8592-ef1b19592f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686a11fa-112b-4bc2-8592-ef1b19592f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c57bb2-5794-4aab-be47-2dcb31f6d71b', 'volume_name': 'volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430540c0-86f5-4e24-b83a-91a9d5fa200d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (430540c0-86f5-4e24-b83a-91a9d5fa200d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99f353b-6ae2-42f7-a0b4-a019f4d86f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:52 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume 65c57bb2-5794-4aab-be47-2dcb31f6d71b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b', 'volume_size': 1} Nov 03 18:40:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-8b000a70-d752-4280-8824-af4704b13897-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-8b000a70-d752-4280-8824-af4704b13897-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-quobyte-8b000a70-d752-4280-8824-af4704b13897" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-8b000a70-d752-4280-8824-af4704b13897" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:53 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 1G" returned: 0 in 0.456s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1e5c8c-c278-4c28-8883-544caeff376f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eeed9b-753b-4b71-b17f-8b2b96234edb]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:53 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1e5c8c-c278-4c28-8883-544caeff376f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 Nov 03 18:40:53 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:53 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 Nov 03 18:40:53 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:53 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1e5c8c-c278-4c28-8883-544caeff376f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:53 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 is being set with open permissions: ugo+rw Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:53 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 Nov 03 18:40:53 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:53 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897" returned: 0 in 0.392s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:53 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897 Nov 03 18:40:53 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:53 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:53 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info Nov 03 18:40:53 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:53 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8b000a70-d752-4280-8824-af4704b13897" returned: 0 in 0.259s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-8b000a70-d752-4280-8824-af4704b13897" released by "delete_volume" :: held 0.701s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Created reservations ['518c53b6-497e-4b7a-a023-9082952a013e', '3a6e7f47-c234-42be-a095-4b23aa48aa78', '51823b5d-4fe7-483d-8a6a-3156d819cee5', 'b6c7aa7c-765e-405f-9392-64453ae8e5a5'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:54 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:54 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:54 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info" returned: 0 in 0.282s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:54 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info is being set with open permissions: ugo+rw Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:54 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info Nov 03 18:40:54 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-ff36438d-b8de-47bc-b5bb-c4c529691ac0-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:54 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.271s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Deleted volume successfully. Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-ff36438d-b8de-47bc-b5bb-c4c529691ac0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-a474d13a-988a-4b5c-ac2d-cc4070e9470f tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-8b000a70-d752-4280-8824-af4704b13897-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:54 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.info" returned: 0 in 0.285s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.109s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1779721393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a73bd0-de1a-4ccf-ba96-44b39d971a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:51Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Creating volume 77a73bd0-de1a-4ccf-ba96-44b39d971a31 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:54 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:54 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 1073741824 Nov 03 18:40:54 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-quobyte-ff36438d-b8de-47bc-b5bb-c4c529691ac0" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-58f2036d-9f30-4e21-bd9f-f13863db4179 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Create snapshot completed successfully Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-ff36438d-b8de-47bc-b5bb-c4c529691ac0" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643af38-aa47-4e09-8705-d836c40b2ab6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:54 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 Nov 03 18:40:54 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:54 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 1073741824" returned: 0 in 0.440s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:54 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0" returned: 0 in 0.388s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:54 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 Nov 03 18:40:54 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:54 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0 Nov 03 18:40:54 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:55 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:55 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-ff36438d-b8de-47bc-b5bb-c4c529691ac0" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31" returned: 0 in 0.274s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-ff36438d-b8de-47bc-b5bb-c4c529691ac0" released by "delete_volume" :: held 0.694s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161468061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576337ac-a6f3-4e1f-b570-92f00fc21733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:51Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Creating volume 576337ac-a6f3-4e1f-b570-92f00fc21733 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:55 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:55 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 1073741824 Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50cc6970-7ced-469f-99ac-7790991a4d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:55 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f994fed8-1623-462c-85a3-43a1db1c1e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 (77a73bd0-de1a-4ccf-ba96-44b39d971a31): created successfully Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f994fed8-1623-462c-85a3-43a1db1c1e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (9f0aeb43-4e5e-4c1b-ac7f-1f5cb116eb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-38ee2011-b909-44e8-8f54-41726729dfa8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created volume successfully. Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Created reservations ['ef66cc24-824d-4172-a07d-f27cbaca4058', '40f08697-95a1-4947-bd7b-e88ab3779411', '81802a89-c96b-4f2d-8b26-763c016214de', '7a6e21aa-5fe0-4df6-885f-f443a6f3e5b7'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:55 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:55 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-d8983ee5-9087-4535-b542-124f9939ff7f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-d8983ee5-9087-4535-b542-124f9939ff7f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-quobyte-d8983ee5-9087-4535-b542-124f9939ff7f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-d8983ee5-9087-4535-b542-124f9939ff7f" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[621eace6-9e8d-4e2b-b534-07ad2e21d4b8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:55 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.323s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Deleted volume successfully. Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ca0479a3-e651-4f2c-b6f9-464ced798fc4 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-ff36438d-b8de-47bc-b5bb-c4c529691ac0-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:55 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 1073741824" returned: 0 in 0.592s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:55 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f Nov 03 18:40:55 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:55 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 Nov 03 18:40:55 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:56 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733" returned: 0 in 0.324s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.019s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439074551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e9c38f-950c-4e83-8b7d-8b8f676ee155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:52Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Creating volume b4e9c38f-950c-4e83-8b7d-8b8f676ee155 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:56 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:56 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14338dea-f3d5-4d4d-b275-3c5890543822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576337ac-a6f3-4e1f-b570-92f00fc21733', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e509a0-e1c4-4ba4-bc4e-2be275590548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f" returned: 0 in 0.560s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:56 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 1073741824 Nov 03 18:40:56 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:56 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f Nov 03 18:40:56 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (a4454d0b-2a4e-4a57-ae51-553036852f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a8b811-e137-4319-874e-7affebe17165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume volume-576337ac-a6f3-4e1f-b570-92f00fc21733 (576337ac-a6f3-4e1f-b570-92f00fc21733): created successfully Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2e509a0-e1c4-4ba4-bc4e-2be275590548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (6aee4b53-9a5f-42d8-8e62-15ec16c7fb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a8b811-e137-4319-874e-7affebe17165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1734087533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da954653-36c7-470f-98e2-258b881d88d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:56Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d450c6-22b8-433c-8df7-789c0133520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d450c6-22b8-433c-8df7-789c0133520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e7cffd-a73e-4998-bef0-707016fddc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e7cffd-a73e-4998-bef0-707016fddc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da954653-36c7-470f-98e2-258b881d88d9', 'volume_name': 'volume-da954653-36c7-470f-98e2-258b881d88d9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bf4698-4985-49e5-abfe-2b23171529b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06bf4698-4985-49e5-abfe-2b23171529b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789fb045-d126-4420-869a-19fc7a3b32b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume da954653-36c7-470f-98e2-258b881d88d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da954653-36c7-470f-98e2-258b881d88d9', 'volume_size': 1} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-31cd3f18-0606-49da-a561-27b24de28267 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created volume successfully. Nov 03 18:40:56 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d8983ee5-9087-4535-b542-124f9939ff7f" returned: 0 in 0.316s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-d8983ee5-9087-4535-b542-124f9939ff7f" released by "delete_volume" :: held 0.929s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Created reservations ['5339dcec-a19f-4123-8c83-0cbcfd6976b3', '5e098d1a-be89-4b7a-a939-f81f9364a8a6', '88619c24-3b71-4d6f-b6a3-44ad9d3d2706', '7d5b932e-a78c-4f9a-845d-41c1281610ae'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (92ed59bb-acc8-43bf-a4d5-41d1dac4eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff85019-4e4b-4171-990d-a3e12285efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff85019-4e4b-4171-990d-a3e12285efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592393132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e224d2c3-2c66-4e73-aa6e-143a33676818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:56Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05a9399-d0bc-4706-a3e6-4966032bb862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05a9399-d0bc-4706-a3e6-4966032bb862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef785d5-ae12-4c97-b4ba-f0f10f0c3ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef785d5-ae12-4c97-b4ba-f0f10f0c3ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e224d2c3-2c66-4e73-aa6e-143a33676818', 'volume_name': 'volume-e224d2c3-2c66-4e73-aa6e-143a33676818', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fcf39f-940c-44d6-abcd-18f0641e2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fcf39f-940c-44d6-abcd-18f0641e2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1590f32f-b00e-4f92-9af5-86ffdc903828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume e224d2c3-2c66-4e73-aa6e-143a33676818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e224d2c3-2c66-4e73-aa6e-143a33676818', 'volume_size': 1} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:56 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 1073741824" returned: 0 in 0.637s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:56 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:56 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:56 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 Nov 03 18:40:56 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (6bda1dfc-c697-4726-af28-7e6274a620cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84ccc6-b29a-4196-ac69-41ed39d13b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84ccc6-b29a-4196-ac69-41ed39d13b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929283426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e4924c-af27-40f3-84ee-6087b2931077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:57Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3692a6-2fa4-49f4-b12d-1fd5f78df764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3692a6-2fa4-49f4-b12d-1fd5f78df764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efdc919-1fc3-4f06-9847-82d5adab6694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efdc919-1fc3-4f06-9847-82d5adab6694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e4924c-af27-40f3-84ee-6087b2931077', 'volume_name': 'volume-43e4924c-af27-40f3-84ee-6087b2931077', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1735da-16a8-4f53-875e-a18ad1edfc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1735da-16a8-4f53-875e-a18ad1edfc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682eed40-2053-4e66-9d11-4be8f93236d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume 43e4924c-af27-40f3-84ee-6087b2931077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e4924c-af27-40f3-84ee-6087b2931077', 'volume_size': 1} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Deleted volume successfully. Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4d06f6a5-b33b-4b04-804a-41f74206c4cb tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-d8983ee5-9087-4535-b542-124f9939ff7f-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:57 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155" returned: 0 in 0.359s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.876s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0c2791-748c-4987-a114-af78108a112f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c29c872ea740f8b4bdf02650eaf9ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:50Z,use_quota=True,user_id='9bb21a37247045e98af8c62605d347bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f30f90d-a20f-4d8b-a318-fb4bd071e8d2),volume_type_id=4f30f90d-a20f-4d8b-a318-fb4bd071e8d2)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Creating volume 9b0c2791-748c-4987-a114-af78108a112f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644462aa-ec0a-4199-9860-998c46e06591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9b4d3a-6c34-4c41-b38e-3598b37f2f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 (b4e9c38f-950c-4e83-8b7d-8b8f676ee155): created successfully Nov 03 18:40:57 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f 1073741824 Nov 03 18:40:57 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9b4d3a-6c34-4c41-b38e-3598b37f2f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (dc090670-5e9f-4329-9085-f9cb155533c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-990b17df-7789-4759-a071-e8c0c82c6960 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created volume successfully. Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (10675a9d-dafd-40d3-84cc-0eb6216afc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae824f5-28be-4be2-b4e6-a41818ce361a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae824f5-28be-4be2-b4e6-a41818ce361a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868762222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf35e7b8-ba5d-4f9d-89a3-51f933c86220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:57Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cec8a65-cf63-4248-8582-0fce3d1e928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cec8a65-cf63-4248-8582-0fce3d1e928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac55370e-f652-44f6-bb61-9b04e89d4762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac55370e-f652-44f6-bb61-9b04e89d4762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf35e7b8-ba5d-4f9d-89a3-51f933c86220', 'volume_name': 'volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286a6f63-eb9a-45e5-a7a9-6a46093d26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286a6f63-eb9a-45e5-a7a9-6a46093d26c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d356e42-812d-4a39-ae32-48f0c4be8dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume bf35e7b8-ba5d-4f9d-89a3-51f933c86220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220', 'volume_size': 1} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:57 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f 1073741824" returned: 0 in 0.539s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-2e0b39ef-d13f-4623-a1af-be47cda76e96-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-2e0b39ef-d13f-4623-a1af-be47cda76e96-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:57 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f Nov 03 18:40:57 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-quobyte-2e0b39ef-d13f-4623-a1af-be47cda76e96" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-2e0b39ef-d13f-4623-a1af-be47cda76e96" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (043fc923-451c-4175-b784-5c5f89acbcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff3ba85-5f3e-48d0-a6c0-1bd26a77b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3d4da-62f5-4bcb-88f8-45c1867c7a2b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff3ba85-5f3e-48d0-a6c0-1bd26a77b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93064927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2e862b-3600-483e-9bcf-bd6385fb7f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:58Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747df883-9f6e-4c44-86ea-4cfcffab7fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747df883-9f6e-4c44-86ea-4cfcffab7fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3620a10-3d15-44d5-b5e1-a3606fc89152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3620a10-3d15-44d5-b5e1-a3606fc89152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2e862b-3600-483e-9bcf-bd6385fb7f33', 'volume_name': 'volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131b7d82-dd7a-435c-b7a1-fbb09b391fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131b7d82-dd7a-435c-b7a1-fbb09b391fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf9ccc0-d215-447a-964f-60ad8d459ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:57 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume dc2e862b-3600-483e-9bcf-bd6385fb7f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33', 'volume_size': 1} Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:57 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 Nov 03 18:40:57 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:57 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.530s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031919357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fbc670-fe74-4e91-82ed-b21abd15b39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:52Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Creating volume e2fbc670-fe74-4e91-82ed-b21abd15b39d {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:58 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d 1073741824 Nov 03 18:40:58 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Attempting download of c11380af-54cd-4850-9752-ac17cc9eba0c ((None, [{'url': 'file:///opt/stack/data/glance/images/c11380af-54cd-4850-9752-ac17cc9eba0c', 'metadata': {}}])) to volume 9b0c2791-748c-4987-a114-af78108a112f. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c9e67-660f-47b9-a0bc-cce5433f3d00]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70 Nov 03 18:40:58 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96" returned: 0 in 0.422s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96 Nov 03 18:40:58 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d 1073741824" returned: 0 in 0.478s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70" returned: 0 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2e0b39ef-d13f-4623-a1af-be47cda76e96" returned: 0 in 0.294s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-2e0b39ef-d13f-4623-a1af-be47cda76e96" released by "delete_volume" :: held 0.803s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:58 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d Nov 03 18:40:58 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70 Nov 03 18:40:58 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Created reservations ['0b009b4a-2c8d-4125-b751-5eb13e9532fa', '6c74d84c-b670-4b7b-aa67-d5f7e4cfc5e3', '58f1e2a1-92ab-4817-84f1-f44afb3978de', 'fc8e55be-e179-43e4-8759-9233ee78e3ad'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:58 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-8f05e731-2ab8-4a4d-a442-67428de6d3e5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d" returned: 0 in 0.311s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.073s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984827490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c57bb2-5794-4aab-be47-2dcb31f6d71b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e096a4c571b94846b3805e405ddb969a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:53Z,use_quota=True,user_id='d8551c4b920748aabe148725f041796a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Creating volume 65c57bb2-5794-4aab-be47-2dcb31f6d71b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:58 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:58 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70" returned: 1 in 0.432s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c11380af-54cd-4850-9752-ac17cc9eba0c_lac9_y70' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-8f05e731-2ab8-4a4d-a442-67428de6d3e5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:58 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b 1073741824 Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c94b30-9cfb-4ef9-93e2-58639dad7453]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:58 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c461ff96-2529-4251-a05b-4291e7fc8659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c2d23b-2964-4183-9881-71475413cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:40:59 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d (e2fbc670-fe74-4e91-82ed-b21abd15b39d): created successfully Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c2d23b-2964-4183-9881-71475413cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (2acb0e16-6683-4b13-b1cf-8ab2c8ab9e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:40:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ad738411-a701-48fb-b93f-c5bd7e1f7a98 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created volume successfully. Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "cinder-quobyte-8f05e731-2ab8-4a4d-a442-67428de6d3e5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-8f05e731-2ab8-4a4d-a442-67428de6d3e5" acquired by "delete_volume" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:40:59 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93cb8ae-8e56-451a-8a6f-97bbad4eb8d9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD Nov 03 18:40:59 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.340s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Deleted volume successfully. Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f8794e66-86db-41d5-b966-bb9336f37c61 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-2e0b39ef-d13f-4623-a1af-be47cda76e96-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:59 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 Nov 03 18:40:59 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD Nov 03 18:40:59 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b 1073741824" returned: 0 in 0.583s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5" returned: 0 in 0.438s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5 Nov 03 18:40:59 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:40:59 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b Nov 03 18:40:59 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD" returned: 1 in 0.465s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] c11380af-54cd-4850-9752-ac17cc9eba0c was raw, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f Nov 03 18:40:59 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-8f05e731-2ab8-4a4d-a442-67428de6d3e5" returned: 0 in 0.357s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:40:59 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b" returned: 0 in 0.323s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-quobyte-8f05e731-2ab8-4a4d-a442-67428de6d3e5" released by "delete_volume" :: held 0.850s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.666s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1734087533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da954653-36c7-470f-98e2-258b881d88d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:56Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating volume da954653-36c7-470f-98e2-258b881d88d9 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:40:59 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99f353b-6ae2-42f7-a0b4-a019f4d86f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:40:59 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 1073741824 Nov 03 18:40:59 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:40:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccecab06-3e0e-4a29-ab58-87f78d96985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Volume volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b (65c57bb2-5794-4aab-be47-2dcb31f6d71b): created successfully Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccecab06-3e0e-4a29-ab58-87f78d96985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Flow 'volume_create_manager' (c77d6e19-4925-43a9-bcb6-4fce9c14229c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ad62e2d2-737a-4a2f-a7e0-4e64a50bb7bc tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created volume successfully. Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Created reservations ['490997b0-3918-436d-9382-414fcafab4b4', '9804c401-6fa8-4e97-b023-716170e65cd2', 'fa028f62-a66f-458e-8820-0f685aa1612c', '4f9066b0-31ad-4393-ac70-090d2b5b03fd'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:00 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:00 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:00 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f" returned: 0 in 0.508s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c11380af-54cd-4850-9752-ac17cc9eba0c_43766qlydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:00 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f 1G Nov 03 18:41:00 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:00 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:00 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 1073741824" returned: 0 in 0.506s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Deleted volume successfully. Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f01d69-a056-4559-9a06-7cbdcb8314c7 tempest-CreateVolumesFromImageTest-102020439 None] Lock "cinder-8f05e731-2ab8-4a4d-a442-67428de6d3e5-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:00 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 Nov 03 18:41:00 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-65c57bb2-5794-4aab-be47-2dcb31f6d71b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-65c57bb2-5794-4aab-be47-2dcb31f6d71b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-quobyte-65c57bb2-5794-4aab-be47-2dcb31f6d71b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-65c57bb2-5794-4aab-be47-2dcb31f6d71b" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8fe116-e0b9-4c32-89a8-6d5d54e3bf4b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:00 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f 1G" returned: 0 in 0.391s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Downloaded image c11380af-54cd-4850-9752-ac17cc9eba0c ((None, [{'url': 'file:///opt/stack/data/glance/images/c11380af-54cd-4850-9752-ac17cc9eba0c', 'metadata': {}}])) to volume 9b0c2791-748c-4987-a114-af78108a112f successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Temporary image c11380af-54cd-4850-9752-ac17cc9eba0c for user 9bb21a37247045e98af8c62605d347bb is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Marking volume 9b0c2791-748c-4987-a114-af78108a112f as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Copying metadata from image c11380af-54cd-4850-9752-ac17cc9eba0c to 9b0c2791-748c-4987-a114-af78108a112f. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Creating volume glance metadata for volume 9b0c2791-748c-4987-a114-af78108a112f backed by image c11380af-54cd-4850-9752-ac17cc9eba0c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c347b306da27bd29d4271a4ec4856f04', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:41:00 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9" returned: 0 in 0.319s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.172s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592393132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e224d2c3-2c66-4e73-aa6e-143a33676818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:56Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating volume e224d2c3-2c66-4e73-aa6e-143a33676818 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:00 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b Nov 03 18:41:00 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789fb045-d126-4420-869a-19fc7a3b32b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da954653-36c7-470f-98e2-258b881d88d9', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:00 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 1073741824 Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70f0b15-8d0e-4269-a739-60de6571f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:00 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7467006b-b1ad-4641-86b8-1360ddbd944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0c2791-748c-4987-a114-af78108a112f', 'volume_size': 1, 'image_id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c11380af-54cd-4850-9752-ac17cc9eba0c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c347b306da27bd29d4271a4ec4856f04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e7c29c872ea740f8b4bdf02650eaf9ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6f53ff215ada3812ec112169c8f815158c3a19a1be509b823ebd0e2966b324bf0c06d201bdce4683b46ef774e20d1f6cfbc84e2b46f408c70c289a8fbd6e5724', 'id': 'c11380af-54cd-4850-9752-ac17cc9eba0c', 'created_at': datetime.datetime(2026, 11, 3, 17, 40, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 40, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c11380af-54cd-4850-9752-ac17cc9eba0c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150bd37b-8c1b-4348-aed3-270cc3bb9020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume volume-da954653-36c7-470f-98e2-258b881d88d9 (da954653-36c7-470f-98e2-258b881d88d9): created successfully Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70f0b15-8d0e-4269-a739-60de6571f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (a4454d0b-2a4e-4a57-ae51-553036852f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Volume volume-9b0c2791-748c-4987-a114-af78108a112f (9b0c2791-748c-4987-a114-af78108a112f): created successfully Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (150bd37b-8c1b-4348-aed3-270cc3bb9020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Flow 'volume_create_manager' (bc13d3eb-4c6a-4184-a965-351dd55f2485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8b6347ca-eee3-4d5c-a89e-999445966d98 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created volume successfully. Nov 03 18:41:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fb7ebaaa-3a74-4dcb-9ee9-e8d77390efcf tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Created volume successfully. Nov 03 18:41:01 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b" returned: 0 in 0.414s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:01 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b Nov 03 18:41:01 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:01 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 1073741824" returned: 0 in 0.514s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:01 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-65c57bb2-5794-4aab-be47-2dcb31f6d71b" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:01 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 Nov 03 18:41:01 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-65c57bb2-5794-4aab-be47-2dcb31f6d71b" released by "delete_volume" :: held 0.748s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created reservations ['f8579f7f-16d3-45ea-9be4-d127d085180c', 'c4b21c06-7645-4461-92f6-0ccbaef79d22', '375fa170-eddf-482a-bf00-1b52bae338c2', 'aad1d410-4223-4572-b9ae-8a7f71e32369'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:01 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:01 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Acquiring lock "cinder-9b0c2791-748c-4987-a114-af78108a112f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "cinder-9b0c2791-748c-4987-a114-af78108a112f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Acquiring lock "cinder-quobyte-9b0c2791-748c-4987-a114-af78108a112f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "cinder-quobyte-9b0c2791-748c-4987-a114-af78108a112f" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:01 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818" returned: 0 in 0.414s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb1d072-fe41-4af1-9680-f77b168be874]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.756s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929283426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e4924c-af27-40f3-84ee-6087b2931077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:57Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating volume 43e4924c-af27-40f3-84ee-6087b2931077 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:01 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-e2fbc670-fe74-4e91-82ed-b21abd15b39d-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1590f32f-b00e-4f92-9af5-86ffdc903828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e224d2c3-2c66-4e73-aa6e-143a33676818', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:01 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 1073741824 Nov 03 18:41:01 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96e05c2-fd4e-4e5b-8dc8-439d2bbb0897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-e2fbc670-fe74-4e91-82ed-b21abd15b39d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:01 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume volume-e224d2c3-2c66-4e73-aa6e-143a33676818 (e224d2c3-2c66-4e73-aa6e-143a33676818): created successfully Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96e05c2-fd4e-4e5b-8dc8-439d2bbb0897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (92ed59bb-acc8-43bf-a4d5-41d1dac4eabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:01 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-94d5ddc0-12da-4272-9bd0-32842f7a3c5d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created volume successfully. Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.409s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:01 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Deleted volume successfully. Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-quobyte-e2fbc670-fe74-4e91-82ed-b21abd15b39d" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:02 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f Nov 03 18:41:02 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-e2fbc670-fe74-4e91-82ed-b21abd15b39d" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b5b2cc8b-32a7-41b4-b0f8-a5843460c64a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-65c57bb2-5794-4aab-be47-2dcb31f6d71b-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cb72df-7905-487b-9ade-3ebbb1b9fd37]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:02 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d Nov 03 18:41:02 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:02 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f" returned: 0 in 0.593s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:02 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f Nov 03 18:41:02 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:02 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 1073741824" returned: 0 in 0.725s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:02 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 Nov 03 18:41:02 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:02 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d" returned: 0 in 0.558s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:02 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d Nov 03 18:41:02 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:02 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9b0c2791-748c-4987-a114-af78108a112f" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "cinder-quobyte-9b0c2791-748c-4987-a114-af78108a112f" released by "delete_volume" :: held 1.010s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Created reservations ['d3e7aa5c-3370-448e-9e6e-2bce9100c5fe', 'ac12e960-222b-42f1-b858-6e45ad0125b5', '3e4ab8e7-8baf-4ec0-97fe-ba50905ccb40', '416f9615-a481-49fe-9f55-9fe265b9fd16'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:02 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.483s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-868762222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf35e7b8-ba5d-4f9d-89a3-51f933c86220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:57Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating volume bf35e7b8-ba5d-4f9d-89a3-51f933c86220 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:03 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:03 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:03 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:03 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:03 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 1073741824 Nov 03 18:41:03 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682eed40-2053-4e66-9d11-4be8f93236d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e4924c-af27-40f3-84ee-6087b2931077', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcd697b-3a01-41e4-9652-889298a95b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e2fbc670-fe74-4e91-82ed-b21abd15b39d" returned: 0 in 0.395s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:03 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume volume-43e4924c-af27-40f3-84ee-6087b2931077 (43e4924c-af27-40f3-84ee-6087b2931077): created successfully Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dcd697b-3a01-41e4-9652-889298a95b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (6bda1dfc-c697-4726-af28-7e6274a620cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-e2fbc670-fe74-4e91-82ed-b21abd15b39d" released by "delete_volume" :: held 1.055s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-00968a01-78e5-4f95-9ab5-8579bc34b865 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created volume successfully. Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created reservations ['fd8c46e4-8bc5-4111-a99f-8c8319b6b265', '26ec1f2b-b625-4bf3-9570-0b49a18c832d', '35ed53b8-75c4-4f66-b35b-0b6484db82f9', 'fc859499-e430-40be-8265-48827657af0b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:03 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Deleted volume successfully. Nov 03 18:41:03 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:03 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ff21fca9-b792-44d3-a1d8-a49dfc13af8b tempest-VolumeAndVolumeTypeFromImageTest-30124476 None] Lock "cinder-9b0c2791-748c-4987-a114-af78108a112f-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:03 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 1073741824" returned: 0 in 0.580s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:03 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Deleted volume successfully. Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-fd6f2df1-6524-48a7-9baf-a886939271ec tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-e2fbc670-fe74-4e91-82ed-b21abd15b39d-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:03 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 Nov 03 18:41:03 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:03 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220" returned: 0 in 0.302s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.065s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-93064927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2e862b-3600-483e-9bcf-bd6385fb7f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9a80d0b40f44a8b30e63d87e8564d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:40:58Z,use_quota=True,user_id='4af3f498cc3c475a8d40a0177e604c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Creating volume dc2e862b-3600-483e-9bcf-bd6385fb7f33 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:04 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d356e42-812d-4a39-ae32-48f0c4be8dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b3ad89-2453-4754-935c-3d11f5f686d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:04 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 1073741824 Nov 03 18:41:04 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 (bf35e7b8-ba5d-4f9d-89a3-51f933c86220): created successfully Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b3ad89-2453-4754-935c-3d11f5f686d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (10675a9d-dafd-40d3-84cc-0eb6216afc42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f1661fbc-dc16-4004-97f4-765835307c30 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created volume successfully. Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-b4e9c38f-950c-4e83-8b7d-8b8f676ee155-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-b4e9c38f-950c-4e83-8b7d-8b8f676ee155-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-quobyte-b4e9c38f-950c-4e83-8b7d-8b8f676ee155" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-b4e9c38f-950c-4e83-8b7d-8b8f676ee155" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[240db344-b3c7-4bbd-b100-494f858be818]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:04 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 Nov 03 18:41:04 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:04 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 1073741824" returned: 0 in 0.687s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:04 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 Nov 03 18:41:04 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:04 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155" returned: 0 in 0.503s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:04 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155 Nov 03 18:41:04 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:05 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33" returned: 0 in 0.312s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf9ccc0-d215-447a-964f-60ad8d459ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309faf79-0a16-4cf9-a858-4401b4a85c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Volume volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 (dc2e862b-3600-483e-9bcf-bd6385fb7f33): created successfully Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309faf79-0a16-4cf9-a858-4401b4a85c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Flow 'volume_create_manager' (043fc923-451c-4175-b784-5c5f89acbcf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:05 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-53ef8ac6-9354-4d36-8ac0-1865884bff6a tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created volume successfully. Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-b4e9c38f-950c-4e83-8b7d-8b8f676ee155" returned: 0 in 0.393s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Flow 'volume_create_manager' (376fb8b9-d731-40f9-a872-ccf063653678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b52612-2a98-412b-984f-c7f0710f6194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-b4e9c38f-950c-4e83-8b7d-8b8f676ee155" released by "delete_volume" :: held 1.004s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b52612-2a98-412b-984f-c7f0710f6194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-845758690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a69d79-3f2a-41f1-92f3-065b173854cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86212fbc7c5c4506b774d356a449ac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:05Z,use_quota=True,user_id='02c97b511e0e431da017d9c1476eeb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb2b343-689e-40a9-a80c-84a9c49f09c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb2b343-689e-40a9-a80c-84a9c49f09c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bcc71d-71ee-4221-a528-7f83a7620cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bcc71d-71ee-4221-a528-7f83a7620cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a69d79-3f2a-41f1-92f3-065b173854cf', 'volume_name': 'volume-c6a69d79-3f2a-41f1-92f3-065b173854cf', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfec2d0-c852-4b8b-9de0-278fa3021d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdfec2d0-c852-4b8b-9de0-278fa3021d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fed5f0-1a0f-4bc5-8f1b-1055bdfd501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Volume c6a69d79-3f2a-41f1-92f3-065b173854cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a69d79-3f2a-41f1-92f3-065b173854cf', 'volume_size': 1} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-845758690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a69d79-3f2a-41f1-92f3-065b173854cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86212fbc7c5c4506b774d356a449ac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:05Z,use_quota=True,user_id='02c97b511e0e431da017d9c1476eeb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Creating volume c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:05 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:05 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf 1073741824 Nov 03 18:41:05 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created reservations ['e4c8dd6a-0847-47ca-b3ff-134fa6662e66', 'e827bf82-5620-4b05-8e7b-2257f6cfff84', '5d63ed27-9f25-4e8d-8f09-9ef641039da2', '3d773b6c-7add-490b-98ef-418cd6edcd0b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:05 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:05 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:05 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-dc2e862b-3600-483e-9bcf-bd6385fb7f33-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.318s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Deleted volume successfully. Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-dc2e862b-3600-483e-9bcf-bd6385fb7f33-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8200eebc-f22d-49ba-8a4a-4f65ce02b638 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-b4e9c38f-950c-4e83-8b7d-8b8f676ee155-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-dc2e862b-3600-483e-9bcf-bd6385fb7f33" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-dc2e862b-3600-483e-9bcf-bd6385fb7f33" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe3bc89-7b6f-4b5a-bb6f-9dc7bfa97f1c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:05 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf 1073741824" returned: 0 in 0.648s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:06 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf Nov 03 18:41:06 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:06 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 Nov 03 18:41:06 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:06 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:06 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fed5f0-1a0f-4bc5-8f1b-1055bdfd501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a69d79-3f2a-41f1-92f3-065b173854cf', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936b5c6e-12e2-422b-bd04-823d3ebfca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:06 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Volume volume-c6a69d79-3f2a-41f1-92f3-065b173854cf (c6a69d79-3f2a-41f1-92f3-065b173854cf): created successfully Nov 03 18:41:06 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33 Nov 03 18:41:06 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (936b5c6e-12e2-422b-bd04-823d3ebfca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Flow 'volume_create_manager' (376fb8b9-d731-40f9-a872-ccf063653678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-576337ac-a6f3-4e1f-b570-92f00fc21733-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3659d892-4a8a-4dc6-82ba-f1c8e892a65a tempest-VolumeDependencyTests-1201871488 None] Created volume successfully. Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-576337ac-a6f3-4e1f-b570-92f00fc21733-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-quobyte-576337ac-a6f3-4e1f-b570-92f00fc21733" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-576337ac-a6f3-4e1f-b570-92f00fc21733" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8db00f1-c887-4ae1-a5ff-69ea20b0b0a6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:06 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-dc2e862b-3600-483e-9bcf-bd6385fb7f33" returned: 0 in 0.303s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:06 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 Nov 03 18:41:06 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-dc2e862b-3600-483e-9bcf-bd6385fb7f33" released by "delete_volume" :: held 0.823s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['9b798f87-dea6-41d5-a39f-23f228aaf950', 'a79b5a22-1e4f-490b-b1b2-4d39658b7188', 'b0e52158-8fa8-498c-9225-17dafab94ad8', 'f03f9e86-d8a4-4d3f-b7d5-334b970b9ce7'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:06 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:06 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:07 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-bf35e7b8-ba5d-4f9d-89a3-51f933c86220-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-bf35e7b8-ba5d-4f9d-89a3-51f933c86220-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:07 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733 Nov 03 18:41:07 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-bf35e7b8-ba5d-4f9d-89a3-51f933c86220" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-bf35e7b8-ba5d-4f9d-89a3-51f933c86220" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe7d843-50dd-4d2e-8f80-ad09a2bc4304]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:07 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.379s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleted volume successfully. Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd08ffc0-9b2b-484b-a403-421153aec3a0 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-dc2e862b-3600-483e-9bcf-bd6385fb7f33-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:07 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 Nov 03 18:41:07 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:07 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-576337ac-a6f3-4e1f-b570-92f00fc21733" returned: 0 in 0.315s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-576337ac-a6f3-4e1f-b570-92f00fc21733" released by "delete_volume" :: held 0.822s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created reservations ['5bd2db73-4363-4765-ac51-967c83c8cc11', 'a59fc0a7-071f-42f1-9e5e-6394dbf38b47', '6b6b56d7-a501-455a-9dbe-99104a34b81f', 'aac16de2-1f87-41c2-b992-f4d160399ec3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:07 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:07 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-77a73bd0-de1a-4ccf-ba96-44b39d971a31-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-77a73bd0-de1a-4ccf-ba96-44b39d971a31-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:07 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220" returned: 0 in 0.558s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:07 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220 Nov 03 18:41:07 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-quobyte-77a73bd0-de1a-4ccf-ba96-44b39d971a31" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-77a73bd0-de1a-4ccf-ba96-44b39d971a31" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a0f14-fcff-4b6e-8b76-4f96d956ee30]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Creating offline snapshot b5ea4b71-f136-4895-ac93-45539720dd90 of volume c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:41:07 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.427s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1bef0-f299-4ac8-81f1-fd3c31798d25]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:08 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Deleted volume successfully. Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-1fe3ddde-0cd1-4506-96f4-e4a3c6c5c89a tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-576337ac-a6f3-4e1f-b570-92f00fc21733-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:08 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 Nov 03 18:41:08 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:08 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bf35e7b8-ba5d-4f9d-89a3-51f933c86220" returned: 0 in 0.352s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-bf35e7b8-ba5d-4f9d-89a3-51f933c86220" released by "delete_volume" :: held 0.994s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:08 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf Nov 03 18:41:08 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['88f3a523-4516-4ae2-8c36-5d660f3db7a0', '04f65f88-7864-407f-b7fd-ad7970b6313b', '62620d4b-9d4d-4179-af12-aec71f4b8a44', '124c6f66-6831-402c-9dbe-b887ac7b1684'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:08 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:08 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:08 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31" returned: 0 in 0.485s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:08 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31 Nov 03 18:41:08 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:08 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf" returned: 0 in 0.535s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:08 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 1G Nov 03 18:41:08 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:08 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:08 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleted volume successfully. Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d8ea474-3ad5-4a9f-a413-156ba4d17b7d tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-bf35e7b8-ba5d-4f9d-89a3-51f933c86220-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:08 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-77a73bd0-de1a-4ccf-ba96-44b39d971a31" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-77a73bd0-de1a-4ccf-ba96-44b39d971a31" released by "delete_volume" :: held 0.848s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created reservations ['dd82613a-3a2a-4f35-aa47-fbb02b3464b4', 'adc22a2f-0a41-4d00-a5a4-65200f358d5f', '64aa077e-f24f-4bda-bdca-59ac025a0b5b', '42cffccf-0a51-4f21-a603-f0ea5a35ce67'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:08 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:08 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-d81a0050-5e41-46a4-ba33-119ffe997fae-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-d81a0050-5e41-46a4-ba33-119ffe997fae-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "cinder-quobyte-d81a0050-5e41-46a4-ba33-119ffe997fae" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-d81a0050-5e41-46a4-ba33-119ffe997fae" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:09 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 1G" returned: 0 in 0.591s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a69d79-3f2a-41f1-92f3-065b173854cf -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa7931e-6937-4e88-a05c-6f686dd30145]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:09 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a69d79-3f2a-41f1-92f3-065b173854cf -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 Nov 03 18:41:09 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:09 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae Nov 03 18:41:09 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:09 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.383s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Deleted volume successfully. Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8a61832b-09c3-4873-8c11-7c62cce7eeb1 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-77a73bd0-de1a-4ccf-ba96-44b39d971a31-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-43e4924c-af27-40f3-84ee-6087b2931077-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-43e4924c-af27-40f3-84ee-6087b2931077-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-43e4924c-af27-40f3-84ee-6087b2931077" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-43e4924c-af27-40f3-84ee-6087b2931077" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea0ebea-6765-404c-b3a4-01f4e0c34a64]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:09 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae" returned: 0 in 0.422s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:09 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6a69d79-3f2a-41f1-92f3-065b173854cf -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:09 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 is being set with open permissions: ugo+rw Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:09 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae Nov 03 18:41:09 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:09 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 Nov 03 18:41:09 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:09 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 Nov 03 18:41:09 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:09 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d81a0050-5e41-46a4-ba33-119ffe997fae" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:09 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90" returned: 0 in 0.309s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-quobyte-d81a0050-5e41-46a4-ba33-119ffe997fae" released by "delete_volume" :: held 0.800s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:09 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info Nov 03 18:41:09 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:09 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Created reservations ['dd7947b4-4a52-4b07-8a66-7fefc5e9a411', 'e3a864fb-6159-4f20-89a7-b761835890be', '38e7b694-751a-47d0-b80a-e70ced7eba34', '9ca2d280-2fe8-423c-8126-3b8a387be038'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:10 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077" returned: 0 in 0.542s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:10 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077 Nov 03 18:41:10 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:10 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:10 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:10 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info" returned: 0 in 0.308s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:10 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info is being set with open permissions: ugo+rw Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:10 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info Nov 03 18:41:10 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:10 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-43e4924c-af27-40f3-84ee-6087b2931077" returned: 0 in 0.432s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:10 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.419s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-43e4924c-af27-40f3-84ee-6087b2931077" released by "delete_volume" :: held 1.045s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Deleted volume successfully. Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8c5b1dd-7ff8-4568-a0aa-60834e3bf6f8 tempest-CreateVolumesFromSourceVolumeTest-1289919011 None] Lock "cinder-d81a0050-5e41-46a4-ba33-119ffe997fae-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:10 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.info" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.728s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:10 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-44af453e-6109-4f85-a5db-90cd7a745473 tempest-VolumeDependencyTests-1201871488 None] Create snapshot completed successfully Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['80e7ca36-2c46-4f7c-ba8f-57c3fb8af5b2', '94d74cf1-1374-4bcf-8c13-caad23c59d56', 'c082ab0f-252a-412b-8c3b-267321eaf1ca', '08564ba9-7e5c-4bcb-adea-67f406337c2a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:10 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:10 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:11 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.295s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleted volume successfully. Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6b091e56-cd03-47f7-91e8-7c03c9c81f6e tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-43e4924c-af27-40f3-84ee-6087b2931077-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Flow 'volume_create_manager' (db470d80-8169-4d6d-ad9e-d204f719bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73ed629-0b94-4f3d-a054-07c9997a88e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-e224d2c3-2c66-4e73-aa6e-143a33676818-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d73ed629-0b94-4f3d-a054-07c9997a88e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-27363889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d697798a-6957-428e-9917-144bde6136cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86212fbc7c5c4506b774d356a449ac70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5ea4b71-f136-4895-ac93-45539720dd90,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:12Z,use_quota=True,user_id='02c97b511e0e431da017d9c1476eeb93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f26a1c4-50c4-44d3-9474-35d4d0138101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f26a1c4-50c4-44d3-9474-35d4d0138101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c095c4f7-b627-4919-95ab-ef743d67a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c095c4f7-b627-4919-95ab-ef743d67a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd697798a-6957-428e-9917-144bde6136cf', 'volume_name': 'volume-d697798a-6957-428e-9917-144bde6136cf', 'volume_size': 1, 'snapshot_id': 'b5ea4b71-f136-4895-ac93-45539720dd90'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d6347d-5d96-4843-ba5a-2e2b9157d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d6347d-5d96-4843-ba5a-2e2b9157d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61427ab-d797-4c0b-98b2-0fd0dd645079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:11 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Volume d697798a-6957-428e-9917-144bde6136cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d697798a-6957-428e-9917-144bde6136cf', 'volume_size': 1, 'snapshot_id': 'b5ea4b71-f136-4895-ac93-45539720dd90'} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-e224d2c3-2c66-4e73-aa6e-143a33676818-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-quobyte-b5ea4b71-f136-4895-ac93-45539720dd90-d697798a-6957-428e-9917-144bde6136cf" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-b5ea4b71-f136-4895-ac93-45539720dd90-d697798a-6957-428e-9917-144bde6136cf" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Creating volume d697798a-6957-428e-9917-144bde6136cf from snapshot b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-quobyte-d697798a-6957-428e-9917-144bde6136cf" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-d697798a-6957-428e-9917-144bde6136cf" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] snapshot: b5ea4b71-f136-4895-ac93-45539720dd90, volume: d697798a-6957-428e-9917-144bde6136cf, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-e224d2c3-2c66-4e73-aa6e-143a33676818" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-e224d2c3-2c66-4e73-aa6e-143a33676818" acquired by "delete_volume" :: waited 0.060s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[71292400-de19-4029-9cd3-3cac9ba07b47]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be0956c-88cc-4362-95c2-c09448b8cbd3]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:12 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 Nov 03 18:41:12 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:12 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 Nov 03 18:41:12 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:12 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a69d79-3f2a-41f1-92f3-065b173854cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:41:12 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818" returned: 0 in 0.444s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3914d8f5-7c14-4eed-85dc-019458c2851f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:12 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818 Nov 03 18:41:12 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:12 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf Nov 03 18:41:12 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:12 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e224d2c3-2c66-4e73-aa6e-143a33676818" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-e224d2c3-2c66-4e73-aa6e-143a33676818" released by "delete_volume" :: held 0.841s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['ebfe5bb1-f19e-4940-bd3a-71c071ed6fee', '64b341d1-5cea-4623-ae91-3d44157499ff', '7a469478-fdd0-4cd5-a628-f7b943065693', '327633fb-d000-4b5e-8448-bb2ddadedec3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:12 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf" returned: 0 in 0.496s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:12 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf Nov 03 18:41:12 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:13 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:13 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:13 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.322s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleted volume successfully. Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd7d2f39-92c2-4e04-a3a9-1a1cde2bc0df tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-e224d2c3-2c66-4e73-aa6e-143a33676818-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Flow 'volume_create_manager' (aa7cf993-55dc-4387-a4c3-72d6c9a394b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a088b16c-6813-4183-b6ec-229b5a34d75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a088b16c-6813-4183-b6ec-229b5a34d75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83247f66-33da-47e9-8988-7f6206367626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cc62064f8b409ca9e35ccf19e65bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:14Z,use_quota=True,user_id='7f28849270ce489f9b744c64136ea132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9223894f-6534-47ba-9f04-91eb97b9445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9223894f-6534-47ba-9f04-91eb97b9445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fcba7f-d2d0-47c1-93f2-41ab323b2305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:13 devstack cinder-volume[86841]: DEBUG cinder.image.glance [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Creating Keystone auth plugin from conf {{(pid=86841) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-da954653-36c7-470f-98e2-258b881d88d9-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-da954653-36c7-470f-98e2-258b881d88d9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Flow 'volume_create_manager' (931ccfbc-5b5a-47cf-804a-ec956a04727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fede35d9-3755-4826-817b-1ce93e535c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fede35d9-3755-4826-817b-1ce93e535c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf97028-99f8-4f32-9975-503b87caff5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573f48e2169842c0bc8749ea9df846ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:14Z,use_quota=True,user_id='f65d2c7f67fd45099acd1af7067367b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a60d59-f3c6-41bc-bf57-1f0cc346e429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a60d59-f3c6-41bc-bf57-1f0cc346e429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f5eefb-6be2-425a-936e-cdfbd0a705cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f5eefb-6be2-425a-936e-cdfbd0a705cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf97028-99f8-4f32-9975-503b87caff5c', 'volume_name': 'volume-caf97028-99f8-4f32-9975-503b87caff5c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5670c3-637e-449c-adf0-edff02e5b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5670c3-637e-449c-adf0-edff02e5b374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd62dced-fb2d-4f46-a022-f52535c1766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Volume caf97028-99f8-4f32-9975-503b87caff5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf97028-99f8-4f32-9975-503b87caff5c', 'volume_size': 1} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-da954653-36c7-470f-98e2-258b881d88d9" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-da954653-36c7-470f-98e2-258b881d88d9" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f191d-efd0-4d08-be0a-9af81099bac9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:14 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 Nov 03 18:41:14 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11fcba7f-d2d0-47c1-93f2-41ab323b2305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83247f66-33da-47e9-8988-7f6206367626', 'volume_name': 'volume-83247f66-33da-47e9-8988-7f6206367626', 'volume_size': 1, 'image_id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48360e4d-e87c-444f-98c9-834e6b43a8e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c22a907d632c89d0612389f0527d2a55', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93cc62064f8b409ca9e35ccf19e65bc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff56d815d761be425622e92997da4643725aa5c718ff6cd0cbbbc25d014ab56c8a57d4b295447b5fd1a77361a0c6748d5ad03dcd48cadf127d22e8695bba8ab3', 'id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'created_at': datetime.datetime(2026, 11, 3, 17, 41, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 41, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48360e4d-e87c-444f-98c9-834e6b43a8e2/file', 'properties': {}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b508fc66-0574-48b2-9b95-5a49b8430569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b508fc66-0574-48b2-9b95-5a49b8430569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839e096a-1f54-4d3f-9962-d51f5eb527a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:14 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Volume 83247f66-33da-47e9-8988-7f6206367626: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83247f66-33da-47e9-8988-7f6206367626', 'volume_size': 1, 'image_id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48360e4d-e87c-444f-98c9-834e6b43a8e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c22a907d632c89d0612389f0527d2a55', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93cc62064f8b409ca9e35ccf19e65bc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff56d815d761be425622e92997da4643725aa5c718ff6cd0cbbbc25d014ab56c8a57d4b295447b5fd1a77361a0c6748d5ad03dcd48cadf127d22e8695bba8ab3', 'id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'created_at': datetime.datetime(2026, 11, 3, 17, 41, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 41, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48360e4d-e87c-444f-98c9-834e6b43a8e2/file', 'properties': {}}, 'image_service': } Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Trying to clone 83247f66-33da-47e9-8988-7f6206367626 from image 48360e4d-e87c-444f-98c9-834e6b43a8e2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/48360e4d-e87c-444f-98c9-834e6b43a8e2', 'metadata': {}}]). {{(pid=86841) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 03 18:41:14 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 03 18:41:14 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Image download 0.00 MB at 0.00 MB/s Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[424ff7e7-6288-4b0e-8f37-153c7f35651d]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:15 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD Nov 03 18:41:15 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:15 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9" returned: 0 in 0.771s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:15 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9 Nov 03 18:41:15 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:15 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:15 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-da954653-36c7-470f-98e2-258b881d88d9" returned: 0 in 0.425s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-da954653-36c7-470f-98e2-258b881d88d9" released by "delete_volume" :: held 1.292s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:15 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD Nov 03 18:41:15 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['830619c2-90a8-4900-bb98-08db148daa80', '436728e7-ea70-480b-9bca-85d096948dbb', 'de19787a-a609-4484-bf83-c5cfe223978e', '542d535d-933f-444a-84dd-92467c7cffea'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:16 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:16 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:16 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD" returned: 1 in 0.543s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Temporary image 48360e4d-e87c-444f-98c9-834e6b43a8e2 is fetched for user 7f28849270ce489f9b744c64136ea132. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f3b3f-5c32-4b76-908a-4d2f366777fe]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:16 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleted volume successfully. Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-09f458a0-99ea-43d5-affb-d09a0ba76b03 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-da954653-36c7-470f-98e2-258b881d88d9-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:16 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD Nov 03 18:41:16 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-cb1e5c8c-c278-4c28-8883-544caeff376f" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-cb1e5c8c-c278-4c28-8883-544caeff376f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleting offline snapshot 2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 of volume cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] snapshot_file for this snap is: volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa223c6-fc1d-4b7e-af71-66edcba971c6]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:16 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD" returned: 0 in 0.634s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:16 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 Nov 03 18:41:16 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:17 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD Nov 03 18:41:17 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:17 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" returned: 0 in 0.592s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb1e5c8c-c278-4c28-8883-544caeff376f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0853db-11f6-4564-a042-238dd159f7b7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:17 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD" returned: 1 in 0.662s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:41:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:17 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f Nov 03 18:41:17 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:18 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f" returned: 0 in 0.707s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:18 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 Nov 03 18:41:18 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:18 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" returned: 0 in 0.540s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:18 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6 Nov 03 18:41:18 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:19 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f.2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" returned: 0 in 0.464s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6" released by "_delete_snapshot" :: held 2.530s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-cb1e5c8c-c278-4c28-8883-544caeff376f" released by "delete_snapshot" :: held 2.570s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:19 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['a0a22d3b-a49d-4f89-a956-43704bb9755c', 'eef99098-013b-4a06-8138-07b4f9f42c4a', 'ea846078-38f0-44e8-b721-a4211c418af0', '07788d85-61a6-4611-9022-a8a2375cd1c3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:19 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Delete snapshot completed successfully. Nov 03 18:41:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f0b0f515-4441-4768-89b9-e21fd8630b7f tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-2d4d14ff-3d7e-4ca3-bc32-3d4c8674dcd6-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-cb1e5c8c-c278-4c28-8883-544caeff376f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-cb1e5c8c-c278-4c28-8883-544caeff376f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "cinder-quobyte-cb1e5c8c-c278-4c28-8883-544caeff376f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-cb1e5c8c-c278-4c28-8883-544caeff376f" acquired by "delete_volume" :: waited 0.055s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a73d6a-2704-4dd0-9cc2-c9cc6b605817]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:20 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f Nov 03 18:41:20 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:20 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:20 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f" returned: 0 in 0.652s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf" returned: 0 in 8.003s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:41:20 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Converted 1024.00 MB image at 127.91 MB/s Nov 03 18:41:20 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf is being set with open permissions: ugo+rw Nov 03 18:41:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:20 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f Nov 03 18:41:20 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:20 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf Nov 03 18:41:20 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:21 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-cb1e5c8c-c278-4c28-8883-544caeff376f" returned: 0 in 0.264s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:21 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf" returned: 0 in 0.277s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-quobyte-cb1e5c8c-c278-4c28-8883-544caeff376f" released by "delete_volume" :: held 1.056s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-d697798a-6957-428e-9917-144bde6136cf" released by "_copy_volume_from_snapshot" :: held 9.369s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-b5ea4b71-f136-4895-ac93-45539720dd90-d697798a-6957-428e-9917-144bde6136cf" released by "_create_volume_from_snapshot" :: held 9.458s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.484s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf97028-99f8-4f32-9975-503b87caff5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573f48e2169842c0bc8749ea9df846ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:14Z,use_quota=True,user_id='f65d2c7f67fd45099acd1af7067367b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Creating volume caf97028-99f8-4f32-9975-503b87caff5c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:21 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Created reservations ['f25ccbf9-6686-440e-9767-603bb9af699a', '57c32315-0320-4541-b824-caab16bab1ed', '7f92f74c-17e6-4175-8785-476a0970da2b', 'f7c5aa21-ea7c-4018-a190-8dec3bb026e3'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:21 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c 1073741824 Nov 03 18:41:21 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61427ab-d797-4c0b-98b2-0fd0dd645079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d697798a-6957-428e-9917-144bde6136cf', 'volume_size': 1, 'snapshot_id': 'b5ea4b71-f136-4895-ac93-45539720dd90'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3827a7e-1c23-4aef-9564-c1aff76ea91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:21 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Volume volume-d697798a-6957-428e-9917-144bde6136cf (d697798a-6957-428e-9917-144bde6136cf): created successfully Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3827a7e-1c23-4aef-9564-c1aff76ea91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Flow 'volume_create_manager' (db470d80-8169-4d6d-ad9e-d204f719bb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:21 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-df0b310e-3d41-4be5-a7e9-f2f063b74f99 tempest-VolumeDependencyTests-1201871488 None] Created volume successfully. Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:21 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:21 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:21 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.296s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:21 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Deleted volume successfully. Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c5e54380-c1e5-4605-964d-edf40600cf61 tempest-CreateVolumesFromSnapshotTest-2107982483 None] Lock "cinder-cb1e5c8c-c278-4c28-8883-544caeff376f-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-b5ea4b71-f136-4895-ac93-45539720dd90-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-b5ea4b71-f136-4895-ac93-45539720dd90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-quobyte-c6a69d79-3f2a-41f1-92f3-065b173854cf" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:21 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c 1073741824" returned: 0 in 0.496s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-c6a69d79-3f2a-41f1-92f3-065b173854cf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-quobyte-b5ea4b71-f136-4895-ac93-45539720dd90" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-b5ea4b71-f136-4895-ac93-45539720dd90" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Deleting offline snapshot b5ea4b71-f136-4895-ac93-45539720dd90 of volume c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] snapshot_file for this snap is: volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6ac63-75f5-4d7a-9b33-f997b7d6dfd1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:21 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c Nov 03 18:41:21 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:22 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 Nov 03 18:41:22 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:22 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c" returned: 0 in 0.253s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.576s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83247f66-33da-47e9-8988-7f6206367626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93cc62064f8b409ca9e35ccf19e65bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:14Z,use_quota=True,user_id='7f28849270ce489f9b744c64136ea132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Creating volume 83247f66-33da-47e9-8988-7f6206367626 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:22 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd62dced-fb2d-4f46-a022-f52535c1766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf97028-99f8-4f32-9975-503b87caff5c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:22 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 1073741824 Nov 03 18:41:22 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e6a5a7-85be-474f-85e8-651b0d49d3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:22 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Volume volume-caf97028-99f8-4f32-9975-503b87caff5c (caf97028-99f8-4f32-9975-503b87caff5c): created successfully Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e6a5a7-85be-474f-85e8-651b0d49d3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Flow 'volume_create_manager' (931ccfbc-5b5a-47cf-804a-ec956a04727a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:22 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ca23cf1b-d46b-40df-b920-d36e1c81387e tempest-CinderUnicodeTest-1680865292 None] Created volume successfully. Nov 03 18:41:22 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90" returned: 0 in 0.392s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6a69d79-3f2a-41f1-92f3-065b173854cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f41d9d-0def-4a58-a0ae-ae2fe906ab7c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:22 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf Nov 03 18:41:22 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:22 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 1073741824" returned: 0 in 0.530s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:22 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 Nov 03 18:41:22 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:22 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf" returned: 0 in 0.648s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:23 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:23 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 Nov 03 18:41:23 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Attempting download of 48360e4d-e87c-444f-98c9-834e6b43a8e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/48360e4d-e87c-444f-98c9-834e6b43a8e2', 'metadata': {}}])) to volume 83247f66-33da-47e9-8988-7f6206367626. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d48a821-e159-4ec1-a986-dda45a6ae251]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:23 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6 Nov 03 18:41:23 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:23 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90" returned: 0 in 0.507s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:23 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90 Nov 03 18:41:23 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Flow 'volume_create_manager' (0b031e75-17b9-48c0-9e8c-bf2421082925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d44463a-43c3-4d19-b831-0cb0a2849fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d44463a-43c3-4d19-b831-0cb0a2849fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1641949313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e74c96-a25a-471c-a71a-1a78f82f35b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573f48e2169842c0bc8749ea9df846ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:23Z,use_quota=True,user_id='f65d2c7f67fd45099acd1af7067367b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f12516-0404-4c8c-a40f-d5ec864f6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:23 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f12516-0404-4c8c-a40f-d5ec864f6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe1101c-baf7-4a32-8c54-374a7113bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe1101c-baf7-4a32-8c54-374a7113bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e74c96-a25a-471c-a71a-1a78f82f35b8', 'volume_name': 'volume-66e74c96-a25a-471c-a71a-1a78f82f35b8', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6433c5a2-11f6-499e-96b9-c683690ccc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6433c5a2-11f6-499e-96b9-c683690ccc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e7fb02-0967-4dda-9290-b2cf57c50acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:23 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Volume 66e74c96-a25a-471c-a71a-1a78f82f35b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e74c96-a25a-471c-a71a-1a78f82f35b8', 'volume_size': 1} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1641949313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e74c96-a25a-471c-a71a-1a78f82f35b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573f48e2169842c0bc8749ea9df846ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:23Z,use_quota=True,user_id='f65d2c7f67fd45099acd1af7067367b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Creating volume 66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:23 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6" returned: 0 in 0.574s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:23 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 1073741824 Nov 03 18:41:23 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:23 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf.b5ea4b71-f136-4895-ac93-45539720dd90" returned: 0 in 0.299s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:23 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6 Nov 03 18:41:23 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-b5ea4b71-f136-4895-ac93-45539720dd90" released by "_delete_snapshot" :: held 2.003s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-c6a69d79-3f2a-41f1-92f3-065b173854cf" released by "delete_snapshot" :: held 2.031s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:23 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Created reservations ['5f0d109d-b849-4bcb-be1d-cfeb2aa49fbc', '5bbc6e7c-905d-439d-b0a7-4f3295d3eeab', 'b8166d57-47a7-4b60-900b-3be9f7420762', '240999d3-174c-4dbe-9c4c-896f4e198aeb'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Delete snapshot completed successfully. Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd8a55c0-ef71-43f1-9583-ee21a484f57e tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-b5ea4b71-f136-4895-ac93-45539720dd90-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:24 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6" returned: 1 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48360e4d-e87c-444f-98c9-834e6b43a8e2_czj6lkr6' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[075d0245-9c30-4372-b1a4-6c1a4e86ca88]: (4, 'raw') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:24 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 1073741824" returned: 0 in 0.540s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:24 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD Nov 03 18:41:24 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:24 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 Nov 03 18:41:24 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:24 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:24 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8" returned: 0 in 0.267s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e7fb02-0967-4dda-9290-b2cf57c50acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e74c96-a25a-471c-a71a-1a78f82f35b8', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be733b79-4d47-4b2f-a03a-0ce9d61ac5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:24 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Volume volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 (66e74c96-a25a-471c-a71a-1a78f82f35b8): created successfully Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be733b79-4d47-4b2f-a03a-0ce9d61ac5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Flow 'volume_create_manager' (0b031e75-17b9-48c0-9e8c-bf2421082925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6fd2a2ef-8a7b-4fd8-9a58-f370cc277f78 tempest-CinderUnicodeTest-1680865292 None] Created volume successfully. Nov 03 18:41:24 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD Nov 03 18:41:24 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:24 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] 48360e4d-e87c-444f-98c9-834e6b43a8e2 was raw, converting to qcow2 {{(pid=86841) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 03 18:41:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:24 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 Nov 03 18:41:24 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-c6a69d79-3f2a-41f1-92f3-065b173854cf-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-c6a69d79-3f2a-41f1-92f3-065b173854cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-quobyte-c6a69d79-3f2a-41f1-92f3-065b173854cf" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-c6a69d79-3f2a-41f1-92f3-065b173854cf" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1093ef37-8bab-49cb-aab6-5d825bf8dcd7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:25 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf Nov 03 18:41:25 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:25 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626" returned: 0 in 0.530s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48360e4d-e87c-444f-98c9-834e6b43a8e2_2npixs_qdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:41:25 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Converted 0.00 MB image at 0.00 MB/s Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:25 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 1G Nov 03 18:41:25 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:25 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf" returned: 0 in 0.478s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:25 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf Nov 03 18:41:25 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:25 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 1G" returned: 0 in 0.408s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Downloaded image 48360e4d-e87c-444f-98c9-834e6b43a8e2 ((None, [{'url': 'file:///opt/stack/data/glance/images/48360e4d-e87c-444f-98c9-834e6b43a8e2', 'metadata': {}}])) to volume 83247f66-33da-47e9-8988-7f6206367626 successfully. {{(pid=86841) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Temporary image 48360e4d-e87c-444f-98c9-834e6b43a8e2 for user 7f28849270ce489f9b744c64136ea132 is deleted. {{(pid=86841) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.volume_utils [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Marking volume 83247f66-33da-47e9-8988-7f6206367626 as bootable. {{(pid=86841) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Copying metadata from image 48360e4d-e87c-444f-98c9-834e6b43a8e2 to 83247f66-33da-47e9-8988-7f6206367626. {{(pid=86841) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Creating volume glance metadata for volume 83247f66-33da-47e9-8988-7f6206367626 backed by image 48360e4d-e87c-444f-98c9-834e6b43a8e2 with: {'image_id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c22a907d632c89d0612389f0527d2a55', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86841) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839e096a-1f54-4d3f-9962-d51f5eb527a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83247f66-33da-47e9-8988-7f6206367626', 'volume_size': 1, 'image_id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48360e4d-e87c-444f-98c9-834e6b43a8e2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c22a907d632c89d0612389f0527d2a55', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '93cc62064f8b409ca9e35ccf19e65bc3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff56d815d761be425622e92997da4643725aa5c718ff6cd0cbbbc25d014ab56c8a57d4b295447b5fd1a77361a0c6748d5ad03dcd48cadf127d22e8695bba8ab3', 'id': '48360e4d-e87c-444f-98c9-834e6b43a8e2', 'created_at': datetime.datetime(2026, 11, 3, 17, 41, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 3, 17, 41, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48360e4d-e87c-444f-98c9-834e6b43a8e2/file', 'properties': {}}, 'image_service': }' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848f25da-e229-4450-beaa-56bae2086190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:25 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Volume volume-83247f66-33da-47e9-8988-7f6206367626 (83247f66-33da-47e9-8988-7f6206367626): created successfully Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (848f25da-e229-4450-beaa-56bae2086190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Flow 'volume_create_manager' (aa7cf993-55dc-4387-a4c3-72d6c9a394b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bd19bdea-7d8c-47a1-95c9-c8bc8f028434 tempest-VolumeImageDependencyTests-1809950983 None] Created volume successfully. Nov 03 18:41:26 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c6a69d79-3f2a-41f1-92f3-065b173854cf" returned: 0 in 0.326s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-c6a69d79-3f2a-41f1-92f3-065b173854cf" released by "delete_volume" :: held 0.894s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Creating offline snapshot 7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 of volume 66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5921d7-6ab7-4acc-8e6c-19f09cebbfc0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Created reservations ['0356efe1-08cd-4657-b9ec-1c3f0d6e69c5', '78618f46-b30d-4a3f-a9b5-0ccff432f3aa', '5c0196ad-58ab-4370-83ec-2b1b4f0a6ed8', 'ce211e1e-eaad-49fb-b2d9-1ee458d1d4e9'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:26 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 Nov 03 18:41:26 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:26 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:26 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-d697798a-6957-428e-9917-144bde6136cf-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-d697798a-6957-428e-9917-144bde6136cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "cinder-quobyte-d697798a-6957-428e-9917-144bde6136cf" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-d697798a-6957-428e-9917-144bde6136cf" acquired by "delete_volume" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef14f07-76a7-4b02-80e9-31ccc1137699]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:26 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.344s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Deleted volume successfully. Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-58567484-aaeb-4ca0-8222-6c2746bea623 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-c6a69d79-3f2a-41f1-92f3-065b173854cf-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:26 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf Nov 03 18:41:26 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:26 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8" returned: 0 in 0.552s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:26 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 1G Nov 03 18:41:26 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Acquiring lock "cinder-83247f66-33da-47e9-8988-7f6206367626-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Lock "cinder-83247f66-33da-47e9-8988-7f6206367626-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Acquiring lock "cinder-quobyte-83247f66-33da-47e9-8988-7f6206367626" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:26 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf" returned: 0 in 0.486s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Lock "cinder-quobyte-83247f66-33da-47e9-8988-7f6206367626" acquired by "delete_volume" :: waited 0.035s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:26 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf Nov 03 18:41:26 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e9fc6-e74e-4784-9acc-0e09d4d15924]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:27 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 Nov 03 18:41:27 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 1G" returned: 0 in 0.477s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:27 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 Nov 03 18:41:27 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d697798a-6957-428e-9917-144bde6136cf" returned: 0 in 0.282s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-quobyte-d697798a-6957-428e-9917-144bde6136cf" released by "delete_volume" :: held 0.832s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Created reservations ['6b56d208-1b11-4fb2-a1fb-92d8ad8c2958', 'e80fc237-4e86-4fc9-b6a6-dbfd3d9c76c9', '9b60da59-3731-4441-b93f-9cc5ab5b8ec8', '179913a0-6193-44bf-ab4a-885b99d9948c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:27 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:27 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626" returned: 0 in 0.425s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:27 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626 Nov 03 18:41:27 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 is being set with open permissions: ugo+rw Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:27 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 Nov 03 18:41:27 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.307s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Deleted volume successfully. Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-812f7a6b-01af-449f-bff8-19e5027ae2c1 tempest-VolumeDependencyTests-1201871488 None] Lock "cinder-d697798a-6957-428e-9917-144bde6136cf-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:27 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-83247f66-33da-47e9-8988-7f6206367626" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Lock "cinder-quobyte-83247f66-33da-47e9-8988-7f6206367626" released by "delete_volume" :: held 0.831s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:27 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" returned: 0 in 0.326s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Created reservations ['966e2058-8fdb-4177-9c74-8395d88b8be8', '23a0131a-fd4d-48a2-b6b7-19cbf84c11b7', '1acb4243-36de-49a6-9827-2bb00fce1b69', 'e670eac6-2fac-4688-8f88-d4117baefc71'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:27 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info Nov 03 18:41:27 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:28 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:28 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:28 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info" returned: 0 in 0.395s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:28 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info is being set with open permissions: ugo+rw Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:28 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info Nov 03 18:41:28 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:28 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Deleted volume successfully. Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9b882dc3-4ba5-4f51-a3e4-0d3e141254ef tempest-VolumeImageDependencyTests-1809950983 None] Lock "cinder-83247f66-33da-47e9-8988-7f6206367626-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:28 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.info" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d7d119d9-5d3c-44a2-92f5-544cb8e411dd tempest-CinderUnicodeTest-1680865292 None] Create snapshot completed successfully Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-quobyte-66e74c96-a25a-471c-a71a-1a78f82f35b8" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-66e74c96-a25a-471c-a71a-1a78f82f35b8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-quobyte-7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Deleting offline snapshot 7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 of volume 66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] snapshot_file for this snap is: volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e927bf-5965-4129-b257-ba0f5ceee136]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:29 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 Nov 03 18:41:29 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:29 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" returned: 0 in 0.428s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e74c96-a25a-471c-a71a-1a78f82f35b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38047b-b4e5-447e-858f-e8fc66f677d4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:30 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 Nov 03 18:41:30 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:30 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8" returned: 0 in 0.445s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:30 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 Nov 03 18:41:30 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:30 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" returned: 0 in 0.480s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:30 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2 Nov 03 18:41:30 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:31 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8.7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" returned: 0 in 0.381s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2" released by "_delete_snapshot" :: held 1.923s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-66e74c96-a25a-471c-a71a-1a78f82f35b8" released by "delete_snapshot" :: held 1.965s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Created reservations ['1d525e19-becd-4cb4-b33a-bc303d58f303', '50a03d45-f9fa-4bb4-a839-04ffcc98d540', 'ab764b82-1357-42f8-91f3-082792b5fde4', 'bd269954-ff5b-4e1b-a344-96d55c0c6e3b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Delete snapshot completed successfully. Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-f01728f1-a2e9-4bf1-a875-b525d11066ab tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-7267ba3e-7a2c-4049-9a32-0d4ee5aa2cb2-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-66e74c96-a25a-471c-a71a-1a78f82f35b8-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-66e74c96-a25a-471c-a71a-1a78f82f35b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-quobyte-66e74c96-a25a-471c-a71a-1a78f82f35b8" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-66e74c96-a25a-471c-a71a-1a78f82f35b8" acquired by "delete_volume" :: waited 0.026s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ecbe4-d0ed-483c-96cc-8af700680801]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:31 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 Nov 03 18:41:31 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-116cc804-551d-479d-85f5-29ff6067cd5c tempest-ProjectAdminTests-95614276 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6699981689453, 'free_capacity_gb': 1773.6699981689453, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86841) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 03 18:41:32 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8" returned: 0 in 0.409s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:32 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8 Nov 03 18:41:32 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:32 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-66e74c96-a25a-471c-a71a-1a78f82f35b8" returned: 0 in 0.302s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-66e74c96-a25a-471c-a71a-1a78f82f35b8" released by "delete_volume" :: held 0.795s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Created reservations ['63d6e11e-f09d-4db7-922d-054ea2b213fb', 'b482c416-532f-42eb-8a5c-b84624851b14', 'f5494d68-2a2d-4aec-bb84-4c10b95df846', '91db81ca-e2f2-4761-9ff9-3d6826144e81'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:32 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:32 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-caf97028-99f8-4f32-9975-503b87caff5c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-caf97028-99f8-4f32-9975-503b87caff5c-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "cinder-quobyte-caf97028-99f8-4f32-9975-503b87caff5c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-caf97028-99f8-4f32-9975-503b87caff5c" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e677210-e958-4bf9-8133-03ef0ba83bb8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:32 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.337s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Deleted volume successfully. Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e49e8137-8982-4e09-be28-53ce51b9f7a4 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-66e74c96-a25a-471c-a71a-1a78f82f35b8-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:33 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c Nov 03 18:41:33 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:33 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c" returned: 0 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:33 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c Nov 03 18:41:33 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:33 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-caf97028-99f8-4f32-9975-503b87caff5c" returned: 0 in 0.411s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-quobyte-caf97028-99f8-4f32-9975-503b87caff5c" released by "delete_volume" :: held 0.898s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Created reservations ['47b8810f-741b-43ae-804e-6f1e8420fc54', '6f4c7470-034d-43b0-a535-9f48e28430aa', '67e8861d-944f-4d20-b2a1-16a493555f91', '6a06cc01-0ca4-4d52-82c4-1a0198faa696'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:34 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:34 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:34 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.391s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:34 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Deleted volume successfully. Nov 03 18:41:34 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-28b23b78-c63b-4358-a5ec-c1d615c0b4f2 tempest-CinderUnicodeTest-1680865292 None] Lock "cinder-caf97028-99f8-4f32-9975-503b87caff5c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (e3651c7e-d08a-4ca2-a66d-52a597b089a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1647e060-9265-4504-a7e5-d809ae68473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1647e060-9265-4504-a7e5-d809ae68473f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393188182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1c49ed-38e2-498e-be77-5e2e1b599aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:41Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c930ba7-d039-42a6-887d-8c4ee0aa3859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c930ba7-d039-42a6-887d-8c4ee0aa3859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736eff09-7bd3-4c4d-a7d2-48f13e5c84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736eff09-7bd3-4c4d-a7d2-48f13e5c84c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1c49ed-38e2-498e-be77-5e2e1b599aa5', 'volume_name': 'volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1661a12-1bdb-4a87-9d57-259ad1856e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1661a12-1bdb-4a87-9d57-259ad1856e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce468fb-a5d0-4a58-8812-401d896c7bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Volume 4c1c49ed-38e2-498e-be77-5e2e1b599aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5', 'volume_size': 1} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393188182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1c49ed-38e2-498e-be77-5e2e1b599aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:41Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Creating volume 4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:40 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:40 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 1073741824 Nov 03 18:41:40 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:41 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 1073741824" returned: 0 in 0.583s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:41 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 Nov 03 18:41:41 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:41 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" returned: 0 in 0.300s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce468fb-a5d0-4a58-8812-401d896c7bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d0ec9b-dd37-47e9-8efb-e2721970c7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Volume volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 (4c1c49ed-38e2-498e-be77-5e2e1b599aa5): created successfully Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d0ec9b-dd37-47e9-8efb-e2721970c7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (e3651c7e-d08a-4ca2-a66d-52a597b089a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-25c9a243-53e8-4bd5-a8ec-0bbe38ccb99e tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=197,cinder:UPDATE=276,cinder:INSERT=74,cinder:DELETE=22 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:UPDATE=286,cinder:SELECT=211,cinder:INSERT=76,cinder:DELETE=28 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Creating offline snapshot 3d7f17de-5c5c-45a7-b64c-dc2663a853a4 of volume 4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d44303d-48df-4b20-b18e-668a599ab20d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:43 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 Nov 03 18:41:43 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:44 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" returned: 0 in 0.579s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:44 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 1G Nov 03 18:41:44 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:44 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 1G" returned: 0 in 0.663s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:44 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 Nov 03 18:41:44 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:45 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4" returned: 0 in 0.399s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:45 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 is being set with open permissions: ugo+rw Nov 03 18:41:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:45 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 Nov 03 18:41:45 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:45 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:45 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info Nov 03 18:41:45 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:46 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info" returned: 0 in 0.514s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:46 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info is being set with open permissions: ugo+rw Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:46 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info Nov 03 18:41:46 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:46 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.info" returned: 0 in 0.317s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-26ed8423-f0ed-434e-b61d-5846fac5914d tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-3d7f17de-5c5c-45a7-b64c-dc2663a853a4-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Lock "cinder-3d7f17de-5c5c-45a7-b64c-dc2663a853a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-3d7f17de-5c5c-45a7-b64c-dc2663a853a4" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-3d7f17de-5c5c-45a7-b64c-dc2663a853a4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot 3d7f17de-5c5c-45a7-b64c-dc2663a853a4 of volume 4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73a2d1-e2d9-490e-ae54-05dd533bcedc]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:46 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 Nov 03 18:41:46 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:47 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4" returned: 0 in 0.438s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:41:47 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec4b1c-9526-4e70-ad6c-42dc93591f3a]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:47 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 Nov 03 18:41:47 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:47 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" returned: 0 in 0.543s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:47 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 Nov 03 18:41:47 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:48 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4" returned: 0 in 0.604s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:48 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4 Nov 03 18:41:48 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:48 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5.3d7f17de-5c5c-45a7-b64c-dc2663a853a4" returned: 0 in 0.279s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-3d7f17de-5c5c-45a7-b64c-dc2663a853a4" released by "_delete_snapshot" :: held 2.030s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" released by "delete_snapshot" :: held 2.067s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Created reservations ['b0d507ff-df90-4bee-aa36-5c860abeb83b', '25189975-8107-4829-a5c4-e04105e2e249', '81b7df2b-2fd8-4a01-b741-76e5e787679d', '7109d48a-6b6d-4637-ae1b-966d9f895e06'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:41:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-85ac6322-94f3-448f-91b1-f43410b99b2b tempest-ProjectMemberTests-653481150 None] Lock "cinder-3d7f17de-5c5c-45a7-b64c-dc2663a853a4-delete_snapshot" released by "delete_snapshot" :: held 2.284s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-4c1c49ed-38e2-498e-be77-5e2e1b599aa5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Lock "cinder-4c1c49ed-38e2-498e-be77-5e2e1b599aa5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8613c2-e66b-40ad-826e-9aab1469258f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:50 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 Nov 03 18:41:50 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:50 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" returned: 0 in 0.492s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:50 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5 Nov 03 18:41:50 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:51 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" returned: 0 in 0.417s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4c1c49ed-38e2-498e-be77-5e2e1b599aa5" released by "delete_volume" :: held 1.135s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Created reservations ['d4adb675-b3ac-4c45-825c-cefb562edb92', 'ac3a4074-c08b-4444-b9cb-602317462b2c', 'e744f883-65bb-4264-aaa8-7ffd5f4c7443', '05a53332-060c-42a9-9a03-b0adab44e34b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:51 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:51 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:51 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.380s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:41:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6cd07293-a986-4cb4-8e7e-a93a3a10d6c3 tempest-ProjectMemberTests-653481150 None] Lock "cinder-4c1c49ed-38e2-498e-be77-5e2e1b599aa5-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (5a273a30-7515-413c-98f3-4b5c815df4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626b32c4-04e1-4f7c-92c9-566a2ab46d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626b32c4-04e1-4f7c-92c9-566a2ab46d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570618538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a64c9ba-1400-4b09-8cac-6cabb26fd93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:53Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2f0a62-bce5-4928-811e-fc6a9d9f23df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2f0a62-bce5-4928-811e-fc6a9d9f23df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425d4cc7-9030-4c37-800e-c54434645cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425d4cc7-9030-4c37-800e-c54434645cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a64c9ba-1400-4b09-8cac-6cabb26fd93f', 'volume_name': 'volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553efdfe-bda3-4ccf-ab1b-80abe62464f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553efdfe-bda3-4ccf-ab1b-80abe62464f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef32e786-c980-4917-b449-1be4246ef7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:53 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Volume 4a64c9ba-1400-4b09-8cac-6cabb26fd93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f', 'volume_size': 1} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-570618538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a64c9ba-1400-4b09-8cac-6cabb26fd93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:53Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Creating volume 4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:53 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:53 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f 1073741824 Nov 03 18:41:53 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:53 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f 1073741824" returned: 0 in 0.742s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:54 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f Nov 03 18:41:54 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:54 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" returned: 0 in 0.321s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef32e786-c980-4917-b449-1be4246ef7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a60702-47c5-4084-9827-6ca975cc8547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:54 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Volume volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f (4a64c9ba-1400-4b09-8cac-6cabb26fd93f): created successfully Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a60702-47c5-4084-9827-6ca975cc8547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:54 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (5a273a30-7515-413c-98f3-4b5c815df4b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:54 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-dc45a373-0516-4dba-a089-191fbe908336 tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (4d54fdc3-3c17-4a42-8185-2904e22da55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd0d349-14ac-4ed7-ae0b-2d5ebef203da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd0d349-14ac-4ed7-ae0b-2d5ebef203da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44168633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae393bc-52ec-4dcc-9190-be2e665d4008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:55Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86015ec-f47c-4fe3-b17d-26c0fa1adde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86015ec-f47c-4fe3-b17d-26c0fa1adde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa46fb3-6209-42d6-ba35-90a3d6c64631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa46fb3-6209-42d6-ba35-90a3d6c64631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae393bc-52ec-4dcc-9190-be2e665d4008', 'volume_name': 'volume-bae393bc-52ec-4dcc-9190-be2e665d4008', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60cf06-84a1-4454-835d-0f70386f07e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60cf06-84a1-4454-835d-0f70386f07e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704aefeb-7a09-4057-a709-53ee3c0c5dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Volume bae393bc-52ec-4dcc-9190-be2e665d4008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae393bc-52ec-4dcc-9190-be2e665d4008', 'volume_size': 1} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-44168633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae393bc-52ec-4dcc-9190-be2e665d4008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:55Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Creating volume bae393bc-52ec-4dcc-9190-be2e665d4008 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:55 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:55 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 1073741824 Nov 03 18:41:55 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:55 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 1073741824" returned: 0 in 0.598s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:56 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 Nov 03 18:41:56 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:56 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008" returned: 0 in 0.301s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.890s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704aefeb-7a09-4057-a709-53ee3c0c5dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae393bc-52ec-4dcc-9190-be2e665d4008', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64710296-372d-4204-845f-6e283cb2f3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Creating offline snapshot f5a8ca09-db57-439f-9e9d-279525dcda41 of volume 4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:41:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Volume volume-bae393bc-52ec-4dcc-9190-be2e665d4008 (bae393bc-52ec-4dcc-9190-be2e665d4008): created successfully Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64710296-372d-4204-845f-6e283cb2f3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (4d54fdc3-3c17-4a42-8185-2904e22da55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985e145-9b18-4bd0-b8dc-983649ecd670]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e636da29-8a31-4665-8cff-a4f311c2a201 tempest-ProjectReaderTests-2015476267 None] Created volume successfully. Nov 03 18:41:56 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f Nov 03 18:41:56 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:56 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" returned: 0 in 0.427s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:56 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 1G Nov 03 18:41:56 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:57 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 1G" returned: 0 in 0.556s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:57 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 Nov 03 18:41:57 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-bae393bc-52ec-4dcc-9190-be2e665d4008-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-bae393bc-52ec-4dcc-9190-be2e665d4008-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-quobyte-bae393bc-52ec-4dcc-9190-be2e665d4008" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-bae393bc-52ec-4dcc-9190-be2e665d4008" acquired by "delete_volume" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f52e5d-74e2-4512-bfa8-f46df8b18d62]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:57 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41" returned: 0 in 0.440s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:57 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 is being set with open permissions: ugo+rw Nov 03 18:41:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:57 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 Nov 03 18:41:57 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:57 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 Nov 03 18:41:57 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:58 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41" returned: 0 in 0.372s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Flow 'volume_create_manager' (373d6667-2a27-40c0-b7aa-72dbbaa8a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd708e3-2351-49bb-9f5a-25bafce98320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd708e3-2351-49bb-9f5a-25bafce98320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110262610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5228f5a-41ab-4030-9725-7bede79c41c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379eabb2d5ae4cb797af2c032843becb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:58Z,use_quota=True,user_id='496b5664f08e4ec1bb03486fa0e2edb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:58 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1190e545-cd32-4c0b-9168-daca68369cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1190e545-cd32-4c0b-9168-daca68369cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:58 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722aac6c-e23e-4d80-96b4-df7a3c34936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:58 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722aac6c-e23e-4d80-96b4-df7a3c34936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5228f5a-41ab-4030-9725-7bede79c41c5', 'volume_name': 'volume-e5228f5a-41ab-4030-9725-7bede79c41c5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e42a62-c1ec-493c-ac3e-3b8fce27468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e42a62-c1ec-493c-ac3e-3b8fce27468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b04832-8f6e-4904-862d-1b72e62b0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:58 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Volume e5228f5a-41ab-4030-9725-7bede79c41c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5228f5a-41ab-4030-9725-7bede79c41c5', 'volume_size': 1} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008" returned: 0 in 0.525s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:58 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008 Nov 03 18:41:58 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:58 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info" returned: 0 in 0.306s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:58 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info is being set with open permissions: ugo+rw Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:58 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info Nov 03 18:41:58 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:58 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-bae393bc-52ec-4dcc-9190-be2e665d4008" returned: 0 in 0.339s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-bae393bc-52ec-4dcc-9190-be2e665d4008" released by "delete_volume" :: held 0.931s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Created reservations ['53fe9344-dfc6-42d6-a965-516d62a4d990', 'a6405620-c858-4414-9820-b6febe9e8c4a', '2ef640ab-67bd-4708-8e73-f24dee29fc6d', 'fdd411b2-260f-47cc-b587-c6329fc81219'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:58 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:58 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:58 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.info" returned: 0 in 0.378s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110262610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5228f5a-41ab-4030-9725-7bede79c41c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379eabb2d5ae4cb797af2c032843becb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:58Z,use_quota=True,user_id='496b5664f08e4ec1bb03486fa0e2edb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Creating volume e5228f5a-41ab-4030-9725-7bede79c41c5 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:41:59 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:59 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 1073741824 Nov 03 18:41:59 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-5298bb1c-b3f1-45b8-8ae0-f0838d01a79a tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:41:59 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.359s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:59 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Deleted volume successfully. Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b0f0695d-6418-40a0-8a8a-83f7d8337b77 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-bae393bc-52ec-4dcc-9190-be2e665d4008-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (6157d3d5-a4ce-484a-b5e6-58ec24a77d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4387317-4a90-4f4d-a692-4b9456c1d18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4387317-4a90-4f4d-a692-4b9456c1d18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1774783478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408607f1-4099-4d6a-8e84-ff5e79e3130b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:59Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3ff02e-d5e7-4b90-82bf-796b9247d8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3ff02e-d5e7-4b90-82bf-796b9247d8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec770a8-250c-4000-8736-3a353d9652f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec770a8-250c-4000-8736-3a353d9652f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408607f1-4099-4d6a-8e84-ff5e79e3130b', 'volume_name': 'volume-408607f1-4099-4d6a-8e84-ff5e79e3130b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16620fc1-df3f-4560-9619-d5f715221edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16620fc1-df3f-4560-9619-d5f715221edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff58b0cf-8e86-4232-a5d9-826a6fbe7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:41:59 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Volume 408607f1-4099-4d6a-8e84-ff5e79e3130b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408607f1-4099-4d6a-8e84-ff5e79e3130b', 'volume_size': 1} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:59 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:41:59 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:59 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 1073741824" returned: 0 in 0.614s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:41:59 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 Nov 03 18:41:59 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-f5a8ca09-db57-439f-9e9d-279525dcda41-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Lock "cinder-f5a8ca09-db57-439f-9e9d-279525dcda41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-f5a8ca09-db57-439f-9e9d-279525dcda41" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-f5a8ca09-db57-439f-9e9d-279525dcda41" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot f5a8ca09-db57-439f-9e9d-279525dcda41 of volume 4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:41:59 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.383s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a72fb9c-846b-4545-8b55-47cf9a5255c0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:41:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:00 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5" returned: 0 in 0.338s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1774783478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408607f1-4099-4d6a-8e84-ff5e79e3130b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:41:59Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Creating volume 408607f1-4099-4d6a-8e84-ff5e79e3130b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:00 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:00 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 Nov 03 18:42:00 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b04832-8f6e-4904-862d-1b72e62b0672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5228f5a-41ab-4030-9725-7bede79c41c5', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318820cb-4571-42dd-90e9-e0b5a9e7a636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:00 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b 1073741824 Nov 03 18:42:00 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:00 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Volume volume-e5228f5a-41ab-4030-9725-7bede79c41c5 (e5228f5a-41ab-4030-9725-7bede79c41c5): created successfully Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318820cb-4571-42dd-90e9-e0b5a9e7a636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Flow 'volume_create_manager' (373d6667-2a27-40c0-b7aa-72dbbaa8a473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d238c5fe-c975-4b4d-a3d9-3345d220a4b9 tempest-ProjectReaderTests-968812107 None] Created volume successfully. Nov 03 18:42:00 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41" returned: 0 in 0.419s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2594141-583f-4235-8043-e75236b31530]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:00 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f Nov 03 18:42:00 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Acquiring lock "cinder-e5228f5a-41ab-4030-9725-7bede79c41c5-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Lock "cinder-e5228f5a-41ab-4030-9725-7bede79c41c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:00 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b 1073741824" returned: 0 in 0.586s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Acquiring lock "cinder-quobyte-e5228f5a-41ab-4030-9725-7bede79c41c5" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Lock "cinder-quobyte-e5228f5a-41ab-4030-9725-7bede79c41c5" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd50143-5407-4483-8081-25d436613a0f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:00 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b Nov 03 18:42:00 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:00 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" returned: 0 in 0.499s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:00 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 Nov 03 18:42:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:00 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:00 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 Nov 03 18:42:00 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:01 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b" returned: 0 in 0.335s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff58b0cf-8e86-4232-a5d9-826a6fbe7709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408607f1-4099-4d6a-8e84-ff5e79e3130b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d54f431-70c8-4ab3-b843-fcc383032c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:01 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Volume volume-408607f1-4099-4d6a-8e84-ff5e79e3130b (408607f1-4099-4d6a-8e84-ff5e79e3130b): created successfully Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d54f431-70c8-4ab3-b843-fcc383032c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (6157d3d5-a4ce-484a-b5e6-58ec24a77d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:01 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6413fb0f-da38-4e89-bc3f-8cd330ac00b5 tempest-ProjectReaderTests-2015476267 None] Created volume successfully. Nov 03 18:42:01 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5" returned: 0 in 0.460s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:01 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5 Nov 03 18:42:01 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:01 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41" returned: 0 in 0.469s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:01 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41 Nov 03 18:42:01 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:01 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e5228f5a-41ab-4030-9725-7bede79c41c5" returned: 0 in 0.320s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Lock "cinder-quobyte-e5228f5a-41ab-4030-9725-7bede79c41c5" released by "delete_volume" :: held 0.853s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Created reservations ['be28a6f4-e8f0-4a8b-8752-5e9411bfc7aa', '20cb680c-fbf3-4052-ad4e-c2af6d931959', '9c9df6b9-c8d7-4472-b2c1-8f3a3bb6dfa7', 'a1e8d790-56b1-41d3-a019-e13bdefa6f0f'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:01 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f.f5a8ca09-db57-439f-9e9d-279525dcda41" returned: 0 in 0.276s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-408607f1-4099-4d6a-8e84-ff5e79e3130b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-f5a8ca09-db57-439f-9e9d-279525dcda41" released by "_delete_snapshot" :: held 1.883s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" released by "delete_snapshot" :: held 1.933s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-408607f1-4099-4d6a-8e84-ff5e79e3130b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-quobyte-408607f1-4099-4d6a-8e84-ff5e79e3130b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:01 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:01 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-408607f1-4099-4d6a-8e84-ff5e79e3130b" acquired by "delete_volume" :: waited 0.042s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Created reservations ['069b0f6a-10c4-4a9a-8f16-c1914772f751', 'a32af920-7ec4-4fd1-9774-1c62e67768c6', '84c9a341-4be9-489b-9a74-8bebf8553ddc', '6e332af5-f425-4b72-8ff6-9374a3697dd2'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc91e5a5-bab9-4c63-b31b-b630f1d91644]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-bb727fee-266f-4dd5-80fe-6ab44a6feeee tempest-ProjectMemberTests-653481150 None] Lock "cinder-f5a8ca09-db57-439f-9e9d-279525dcda41-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:02 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b Nov 03 18:42:02 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:02 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.430s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Deleted volume successfully. Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-af9075ee-d889-4baf-be07-e5b81938f71e tempest-ProjectReaderTests-968812107 None] Lock "cinder-e5228f5a-41ab-4030-9725-7bede79c41c5-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Flow 'volume_create_manager' (a65a493d-ee9d-45b0-95c3-a4a710f43ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808308c5-a1c2-4f11-a8c7-ac482dd746cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (808308c5-a1c2-4f11-a8c7-ac482dd746cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892930770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f4c672-944d-4473-ba53-41beaba71d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379eabb2d5ae4cb797af2c032843becb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:02Z,use_quota=True,user_id='496b5664f08e4ec1bb03486fa0e2edb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde38a04-50a2-477c-b7ad-5d439afe1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:02 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde38a04-50a2-477c-b7ad-5d439afe1962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b34a8e2-afdd-4629-a472-e42059a67484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b34a8e2-afdd-4629-a472-e42059a67484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f4c672-944d-4473-ba53-41beaba71d33', 'volume_name': 'volume-d5f4c672-944d-4473-ba53-41beaba71d33', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51406977-7b38-480f-b75a-3aef901e3c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51406977-7b38-480f-b75a-3aef901e3c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46892d84-6896-48b0-acaf-be122004553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:02 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Volume d5f4c672-944d-4473-ba53-41beaba71d33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f4c672-944d-4473-ba53-41beaba71d33', 'volume_size': 1} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892930770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f4c672-944d-4473-ba53-41beaba71d33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379eabb2d5ae4cb797af2c032843becb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:02Z,use_quota=True,user_id='496b5664f08e4ec1bb03486fa0e2edb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Creating volume d5f4c672-944d-4473-ba53-41beaba71d33 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:02 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b" returned: 0 in 0.564s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:02 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 1073741824 Nov 03 18:42:02 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:02 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b Nov 03 18:42:02 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:02 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-408607f1-4099-4d6a-8e84-ff5e79e3130b" returned: 0 in 0.386s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-408607f1-4099-4d6a-8e84-ff5e79e3130b" released by "delete_volume" :: held 1.036s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Created reservations ['1019513c-38bd-4bfd-829b-982a3006951c', 'bed74847-a6e7-4ba3-bfb3-29c6976bc315', '5b7804be-058c-4cd1-a963-d14dc48b6434', 'c36a3487-e477-472e-a7f6-20f9c1269ec8'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:03 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:03 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-4a64c9ba-1400-4b09-8cac-6cabb26fd93f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Lock "cinder-4a64c9ba-1400-4b09-8cac-6cabb26fd93f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:03 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 1073741824" returned: 0 in 0.755s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[8863f2a6-e5c7-4726-a1ce-32ed610ceaf0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:03 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 Nov 03 18:42:03 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:03 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f Nov 03 18:42:03 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:03 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.470s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Deleted volume successfully. Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-e451774a-408c-4df5-9476-697fcd49cc88 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-408607f1-4099-4d6a-8e84-ff5e79e3130b-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:03 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33" returned: 0 in 0.316s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46892d84-6896-48b0-acaf-be122004553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f4c672-944d-4473-ba53-41beaba71d33', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5968d8e-e56a-4c1a-8b8f-54c4b9c5cf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:03 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Volume volume-d5f4c672-944d-4473-ba53-41beaba71d33 (d5f4c672-944d-4473-ba53-41beaba71d33): created successfully Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5968d8e-e56a-4c1a-8b8f-54c4b9c5cf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Flow 'volume_create_manager' (a65a493d-ee9d-45b0-95c3-a4a710f43ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-22a80cf2-4767-4479-869b-2f58c58cfff4 tempest-ProjectReaderTests-968812107 None] Created volume successfully. Nov 03 18:42:03 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" returned: 0 in 0.492s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:03 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f Nov 03 18:42:03 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:04 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" returned: 0 in 0.278s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4a64c9ba-1400-4b09-8cac-6cabb26fd93f" released by "delete_volume" :: held 0.893s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Created reservations ['a82ac84c-f39c-4242-8b19-011848c9995f', '38db66ec-0721-425e-9e47-7ac2c2942674', 'a6945a5e-0208-45a6-8c37-0700bb009a2e', 'b8abe4a3-fc8f-4940-bc5f-ee6828a60845'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:04 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:04 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (e3a12716-15e5-40fd-8627-04ddee9108b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc57ab9-a725-4775-a689-ce3e235afccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Acquiring lock "cinder-d5f4c672-944d-4473-ba53-41beaba71d33-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc57ab9-a725-4775-a689-ce3e235afccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855051564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6361ff00-99e3-493e-962d-ab54ddb4874c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:05Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3af1b1-5309-4ccc-8213-21c434216822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3af1b1-5309-4ccc-8213-21c434216822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be27d1ba-4015-452e-9d69-de2a5ff12c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:04 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be27d1ba-4015-452e-9d69-de2a5ff12c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6361ff00-99e3-493e-962d-ab54ddb4874c', 'volume_name': 'volume-6361ff00-99e3-493e-962d-ab54ddb4874c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb0edb6-7fcb-418a-bd55-285a4223a7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb0edb6-7fcb-418a-bd55-285a4223a7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f080aed2-1c46-458a-99c6-d7459b596bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:04 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Volume 6361ff00-99e3-493e-962d-ab54ddb4874c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6361ff00-99e3-493e-962d-ab54ddb4874c', 'volume_size': 1} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855051564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6361ff00-99e3-493e-962d-ab54ddb4874c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:05Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Creating volume 6361ff00-99e3-493e-962d-ab54ddb4874c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:04 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.356s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Lock "cinder-d5f4c672-944d-4473-ba53-41beaba71d33-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:42:04 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c 1073741824 Nov 03 18:42:04 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6c70394e-f1cd-41aa-b080-2548270a7afc tempest-ProjectMemberTests-653481150 None] Lock "cinder-4a64c9ba-1400-4b09-8cac-6cabb26fd93f-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Acquiring lock "cinder-quobyte-d5f4c672-944d-4473-ba53-41beaba71d33" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Lock "cinder-quobyte-d5f4c672-944d-4473-ba53-41beaba71d33" acquired by "delete_volume" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[921bc399-31fc-4a5a-ace9-504d81822d32]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:05 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 Nov 03 18:42:05 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:05 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c 1073741824" returned: 0 in 0.514s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:05 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33" returned: 0 in 0.384s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:05 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33 Nov 03 18:42:05 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:05 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c Nov 03 18:42:05 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:05 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-d5f4c672-944d-4473-ba53-41beaba71d33" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Lock "cinder-quobyte-d5f4c672-944d-4473-ba53-41beaba71d33" released by "delete_volume" :: held 0.797s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:05 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c" returned: 0 in 0.374s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f080aed2-1c46-458a-99c6-d7459b596bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6361ff00-99e3-493e-962d-ab54ddb4874c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5821c839-311a-4a65-b8d7-cbcaff5c6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:05 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Volume volume-6361ff00-99e3-493e-962d-ab54ddb4874c (6361ff00-99e3-493e-962d-ab54ddb4874c): created successfully Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5821c839-311a-4a65-b8d7-cbcaff5c6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (e3a12716-15e5-40fd-8627-04ddee9108b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:05 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Created reservations ['d5d27c17-13c1-4159-b215-264c7273328c', 'c749f94a-c63b-4a88-a2ae-5d6ac9de3d4d', '8be288df-7220-44b3-83f8-a34b0c340bfc', '7c56a14e-8d7d-4b6d-a597-e7df2c6feb3b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-caf05fa0-4be6-458b-a715-83674593eee8 tempest-ProjectReaderTests-2015476267 None] Created volume successfully. Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:06 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:06 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (4fd342af-8532-4948-96c0-9ac35d9998ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7fcc8a-6d15-4a75-b9de-e5f69fd5e67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7fcc8a-6d15-4a75-b9de-e5f69fd5e67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116717726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bbcf4d-3394-4c51-aaae-829ec408a8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:06Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a13084f-e12e-4550-91e5-bd86578aa725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:06 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a13084f-e12e-4550-91e5-bd86578aa725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5475c6-151a-4c40-a0bb-bd3389c932e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5475c6-151a-4c40-a0bb-bd3389c932e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bbcf4d-3394-4c51-aaae-829ec408a8a1', 'volume_name': 'volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c741b80-1534-4427-b86a-f2a7749067b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c741b80-1534-4427-b86a-f2a7749067b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b25c8e-47e2-48a0-95ac-ea286b8ffd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:06 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Volume 98bbcf4d-3394-4c51-aaae-829ec408a8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1', 'volume_size': 1} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-116717726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98bbcf4d-3394-4c51-aaae-829ec408a8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:06Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Creating volume 98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:06 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.356s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Deleted volume successfully. Nov 03 18:42:06 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 1073741824 Nov 03 18:42:06 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8af1c0fe-f6c6-4443-8565-3e3b1ebf7721 tempest-ProjectReaderTests-968812107 None] Lock "cinder-d5f4c672-944d-4473-ba53-41beaba71d33-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-6361ff00-99e3-493e-962d-ab54ddb4874c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Lock "cinder-6361ff00-99e3-493e-962d-ab54ddb4874c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-quobyte-6361ff00-99e3-493e-962d-ab54ddb4874c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-6361ff00-99e3-493e-962d-ab54ddb4874c" acquired by "delete_volume" :: waited 0.025s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe503ab-1833-4784-989e-4fdc5a938619]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:06 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 1073741824" returned: 0 in 0.662s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:07 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 Nov 03 18:42:07 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:07 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c Nov 03 18:42:07 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:07 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1" returned: 0 in 0.390s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b25c8e-47e2-48a0-95ac-ea286b8ffd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f734204f-e19c-4713-9748-d18bbbc7ee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:07 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Volume volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 (98bbcf4d-3394-4c51-aaae-829ec408a8a1): created successfully Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f734204f-e19c-4713-9748-d18bbbc7ee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (4fd342af-8532-4948-96c0-9ac35d9998ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:07 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c" returned: 0 in 0.539s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bdee3d6c-2919-4d55-8a0e-1db0547e2f0f tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:42:07 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c Nov 03 18:42:07 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:07 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6361ff00-99e3-493e-962d-ab54ddb4874c" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-6361ff00-99e3-493e-962d-ab54ddb4874c" released by "delete_volume" :: held 0.862s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Created reservations ['a347a270-962d-4aa6-8a19-ffa98d0341b4', 'b0f2da5b-75e8-4f70-a633-da030da96d48', 'e8fde14c-1168-4a83-bc85-3617d63e75cc', '832998c4-eea9-4187-94cf-f9aa91e54bb4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:08 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:08 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:08 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.376s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:08 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Deleted volume successfully. Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-6d569793-8794-4b94-be92-cdc3b60ea11a tempest-ProjectReaderTests-2015476267 None] Lock "cinder-6361ff00-99e3-493e-962d-ab54ddb4874c-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Creating offline snapshot 6389deaf-8816-4c2e-923e-6faacc714489 of volume 98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (12a6f7a1-83cc-4ae4-8324-62664c7596f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6925a5-dc61-47e6-bbbd-8e14851ac647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1714e0-86ab-4db5-ba50-ebcd9f213615]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:08 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6925a5-dc61-47e6-bbbd-8e14851ac647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827958940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd44975-4e10-4871-b185-aeafd1fddceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:09Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdbb51e-154e-4264-9ddd-69bf443eb597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdbb51e-154e-4264-9ddd-69bf443eb597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278bf5f3-ed35-4e37-966c-15136b19ad00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278bf5f3-ed35-4e37-966c-15136b19ad00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd44975-4e10-4871-b185-aeafd1fddceb', 'volume_name': 'volume-6fd44975-4e10-4871-b185-aeafd1fddceb', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4eb63b-4f2a-4066-b671-89de2673a2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4eb63b-4f2a-4066-b671-89de2673a2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64612e86-b528-4865-979e-6f635db59c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:09 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Volume 6fd44975-4e10-4871-b185-aeafd1fddceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd44975-4e10-4871-b185-aeafd1fddceb', 'volume_size': 1} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:09 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 Nov 03 18:42:09 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:09 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1" returned: 0 in 0.416s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:09 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 1G Nov 03 18:42:09 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:09 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 1G" returned: 0 in 0.550s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:09 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 Nov 03 18:42:09 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Flow 'volume_create_manager' (a654ebbe-4e21-4c12-9777-b13a6ef90aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e3e47-848c-48a2-8858-c0fae78938ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121e3e47-848c-48a2-8858-c0fae78938ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-984492459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fa4ef5-bd28-4255-9757-37350932a72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03d7dbd3fd24c3f8e3c1c7680fb2b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:10Z,use_quota=True,user_id='999108ed30c24d78b0f2ab303ee7a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e747d07-6725-4db6-a8b5-7a7e9f68893a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e747d07-6725-4db6-a8b5-7a7e9f68893a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acc4cbf-19c4-47bd-a4b7-af467f39c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acc4cbf-19c4-47bd-a4b7-af467f39c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44fa4ef5-bd28-4255-9757-37350932a72e', 'volume_name': 'volume-44fa4ef5-bd28-4255-9757-37350932a72e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4357c5a-4cfe-4d25-b963-7cfe7dd744b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4357c5a-4cfe-4d25-b963-7cfe7dd744b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e434fa-afbd-4652-9b89-59bc890c1ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:10 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Volume 44fa4ef5-bd28-4255-9757-37350932a72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44fa4ef5-bd28-4255-9757-37350932a72e', 'volume_size': 1} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:10 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489" returned: 0 in 0.450s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:10 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 is being set with open permissions: ugo+rw Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:10 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 Nov 03 18:42:10 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:10 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:10 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info Nov 03 18:42:10 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:10 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info" returned: 0 in 0.280s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:10 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info is being set with open permissions: ugo+rw Nov 03 18:42:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:10 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info Nov 03 18:42:10 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:11 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.info" returned: 0 in 0.263s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.405s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827958940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd44975-4e10-4871-b185-aeafd1fddceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb29e155c9e432e9122953bd7c787b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:09Z,use_quota=True,user_id='b111aade694b483f873a72fff9c100c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Creating volume 6fd44975-4e10-4871-b185-aeafd1fddceb {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:11 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:11 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb 1073741824 Nov 03 18:42:11 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:11 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-950b768a-b742-4a36-822a-ce9b420363d6 tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:42:11 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb 1073741824" returned: 0 in 0.439s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:11 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb Nov 03 18:42:11 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-6389deaf-8816-4c2e-923e-6faacc714489-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Lock "cinder-6389deaf-8816-4c2e-923e-6faacc714489-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:11 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-98bbcf4d-3394-4c51-aaae-829ec408a8a1" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-98bbcf4d-3394-4c51-aaae-829ec408a8a1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-6389deaf-8816-4c2e-923e-6faacc714489" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:12 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-6389deaf-8816-4c2e-923e-6faacc714489" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot 6389deaf-8816-4c2e-923e-6faacc714489 of volume 98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb" returned: 0 in 0.325s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-984492459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44fa4ef5-bd28-4255-9757-37350932a72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03d7dbd3fd24c3f8e3c1c7680fb2b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:10Z,use_quota=True,user_id='999108ed30c24d78b0f2ab303ee7a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Creating volume 44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:12 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a3ece5-b1a2-4c6f-8268-ef5de6bad8e8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:12 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e 1073741824 Nov 03 18:42:12 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64612e86-b528-4865-979e-6f635db59c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd44975-4e10-4871-b185-aeafd1fddceb', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02b9c87-5603-477e-824a-d77caf61d288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Volume volume-6fd44975-4e10-4871-b185-aeafd1fddceb (6fd44975-4e10-4871-b185-aeafd1fddceb): created successfully Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02b9c87-5603-477e-824a-d77caf61d288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Flow 'volume_create_manager' (12a6f7a1-83cc-4ae4-8324-62664c7596f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-72ae9a31-0287-4aa0-b1a6-e6a9ad40a91f tempest-ProjectReaderTests-2015476267 None] Created volume successfully. Nov 03 18:42:12 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 Nov 03 18:42:12 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:12 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:12 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e 1073741824" returned: 0 in 0.501s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ccafc9-138e-4d7c-9c38-2ea1b6179f4b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:12 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e Nov 03 18:42:12 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:12 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 Nov 03 18:42:12 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:12 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e" returned: 0 in 0.298s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e434fa-afbd-4652-9b89-59bc890c1ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44fa4ef5-bd28-4255-9757-37350932a72e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3890778f-5ce9-4fd1-8192-819b7fd2968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:12 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Volume volume-44fa4ef5-bd28-4255-9757-37350932a72e (44fa4ef5-bd28-4255-9757-37350932a72e): created successfully Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3890778f-5ce9-4fd1-8192-819b7fd2968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Flow 'volume_create_manager' (a654ebbe-4e21-4c12-9777-b13a6ef90aa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:12 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cc8d69d6-39b6-4b65-b310-53b88375b670 tempest-SnapshotDependencyTests-272894516 None] Created volume successfully. Nov 03 18:42:13 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1" returned: 0 in 0.455s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:13 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 Nov 03 18:42:13 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-6fd44975-4e10-4871-b185-aeafd1fddceb-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-6fd44975-4e10-4871-b185-aeafd1fddceb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "cinder-quobyte-6fd44975-4e10-4871-b185-aeafd1fddceb" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-6fd44975-4e10-4871-b185-aeafd1fddceb" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4b605c-f84b-4792-ade1-71af3f0e7124]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:13 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb Nov 03 18:42:13 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:13 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489" returned: 0 in 0.452s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:13 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489 Nov 03 18:42:13 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:13 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb" returned: 0 in 0.409s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:13 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb Nov 03 18:42:13 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:13 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1.6389deaf-8816-4c2e-923e-6faacc714489" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Creating offline snapshot d38edccf-cb1c-4fa3-871c-f960d256b507 of volume 44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-6389deaf-8816-4c2e-923e-6faacc714489" released by "_delete_snapshot" :: held 1.846s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-98bbcf4d-3394-4c51-aaae-829ec408a8a1" released by "delete_snapshot" :: held 1.872s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6de22f-f1af-4cc4-a722-b2f00f524ac0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:13 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Created reservations ['f7db3cf7-f7c6-40ab-b6c0-af9caf017924', '9fb1972b-53b0-4c78-b54a-48839692c82a', '29a9f521-4068-49ed-8302-8ade0df7290b', '043c6802-bdf1-4b1b-a42e-b35cd482539c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:14 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-6fd44975-4e10-4871-b185-aeafd1fddceb" returned: 0 in 0.374s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-quobyte-6fd44975-4e10-4871-b185-aeafd1fddceb" released by "delete_volume" :: held 0.828s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:14 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e Nov 03 18:42:14 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-ad71bbb1-1077-463b-ab75-5230b2edc625 tempest-ProjectMemberTests-653481150 None] Lock "cinder-6389deaf-8816-4c2e-923e-6faacc714489-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Created reservations ['29c8b07f-52b5-44d8-a1e7-e0f74b19ed96', 'f58f7502-4510-40f5-8bfd-4e1bdd40d517', 'cc115d34-902a-4d0c-878a-f47ccde1626e', 'd13636b0-0ab5-4c12-bc61-e7357df494a4'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-98bbcf4d-3394-4c51-aaae-829ec408a8a1-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Lock "cinder-98bbcf4d-3394-4c51-aaae-829ec408a8a1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-98bbcf4d-3394-4c51-aaae-829ec408a8a1" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-98bbcf4d-3394-4c51-aaae-829ec408a8a1" acquired by "delete_volume" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[208f31f1-546e-4696-ba09-5bbed74c4f04]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:14 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:14 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:14 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e" returned: 0 in 0.538s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:14 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 1G Nov 03 18:42:14 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:14 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 Nov 03 18:42:14 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:14 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.369s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:14 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Deleted volume successfully. Nov 03 18:42:14 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d7b095f2-503a-48ea-b786-4074ece31c12 tempest-ProjectReaderTests-2015476267 None] Lock "cinder-6fd44975-4e10-4871-b185-aeafd1fddceb-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:15 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1" returned: 0 in 0.631s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:15 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1 Nov 03 18:42:15 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 1G" returned: 0 in 0.619s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fa4ef5-bd28-4255-9757-37350932a72e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:15 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fa4ef5-bd28-4255-9757-37350932a72e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 Nov 03 18:42:15 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:15 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-98bbcf4d-3394-4c51-aaae-829ec408a8a1" returned: 0 in 0.276s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-98bbcf4d-3394-4c51-aaae-829ec408a8a1" released by "delete_volume" :: held 1.028s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Created reservations ['40fe406d-25a4-4398-a53a-58cc17fb6dd5', 'b05b902d-1ac6-4aa4-9d73-e3f5615c415d', 'd2758930-e530-4e7e-8a55-60bc21d9e7c6', '9df14f3c-cdad-4135-95b4-122a9c2de765'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:15 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44fa4ef5-bd28-4255-9757-37350932a72e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507" returned: 0 in 0.353s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 is being set with open permissions: ugo+rw Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:15 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 Nov 03 18:42:15 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:15 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:15 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:15 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:15 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.283s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:15 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info Nov 03 18:42:15 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-cd6f27c9-c0ad-44e0-bea3-909b47f55bd5 tempest-ProjectMemberTests-653481150 None] Lock "cinder-98bbcf4d-3394-4c51-aaae-829ec408a8a1-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:15 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info" returned: 0 in 0.270s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:15 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info is being set with open permissions: ugo+rw Nov 03 18:42:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:16 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info Nov 03 18:42:16 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:16 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.info" returned: 0 in 0.267s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:16 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-1b0b0f77-c10e-4020-a07e-26b6cf7af32f tempest-SnapshotDependencyTests-272894516 None] Create snapshot completed successfully Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (4d6bca2f-ec6f-43b3-acca-a9b1f9737177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d24d8c0-614f-4258-9c41-48ccbada7404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d24d8c0-614f-4258-9c41-48ccbada7404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356318569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bafd288-b979-4384-8ee3-9408ee3fff9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:17Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a655f4-4b62-4b48-912a-bc16377b2117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a655f4-4b62-4b48-912a-bc16377b2117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3aa50dc-e31f-425f-ada5-3f7afec26466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3aa50dc-e31f-425f-ada5-3f7afec26466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bafd288-b979-4384-8ee3-9408ee3fff9e', 'volume_name': 'volume-0bafd288-b979-4384-8ee3-9408ee3fff9e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c9901-e2e1-4914-a9ce-d9741f76ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404c9901-e2e1-4914-a9ce-d9741f76ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8371ff51-39bb-4c89-8426-3216a3d323ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:16 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Volume 0bafd288-b979-4384-8ee3-9408ee3fff9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bafd288-b979-4384-8ee3-9408ee3fff9e', 'volume_size': 1} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356318569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bafd288-b979-4384-8ee3-9408ee3fff9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:17Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Creating volume 0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:16 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:16 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e 1073741824 Nov 03 18:42:16 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:17 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e 1073741824" returned: 0 in 0.459s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:17 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e Nov 03 18:42:17 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Flow 'volume_create_manager' (751cd8e4-e2eb-47cd-b925-1b6dc0bcfcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7c4101-889c-416d-824f-828d5a727180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7c4101-889c-416d-824f-828d5a727180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45733f88-b88c-421d-9d1b-884b1415e839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03d7dbd3fd24c3f8e3c1c7680fb2b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d38edccf-cb1c-4fa3-871c-f960d256b507,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:18Z,use_quota=True,user_id='999108ed30c24d78b0f2ab303ee7a70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f315c5e-e35b-40f3-8269-85d084085a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f315c5e-e35b-40f3-8269-85d084085a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1168cd-8ff6-454a-8996-60524848f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1168cd-8ff6-454a-8996-60524848f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45733f88-b88c-421d-9d1b-884b1415e839', 'volume_name': 'volume-45733f88-b88c-421d-9d1b-884b1415e839', 'volume_size': 1, 'snapshot_id': 'd38edccf-cb1c-4fa3-871c-f960d256b507'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea7d440-7832-4b32-a96b-6a5a2dc3a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea7d440-7832-4b32-a96b-6a5a2dc3a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7d1100-2085-4d61-9b65-06c4276fb1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:17 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Volume 45733f88-b88c-421d-9d1b-884b1415e839: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45733f88-b88c-421d-9d1b-884b1415e839', 'volume_size': 1, 'snapshot_id': 'd38edccf-cb1c-4fa3-871c-f960d256b507'} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:17 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e" returned: 0 in 0.257s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.064s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-quobyte-d38edccf-cb1c-4fa3-871c-f960d256b507-45733f88-b88c-421d-9d1b-884b1415e839" by "_create_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8371ff51-39bb-4c89-8426-3216a3d323ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bafd288-b979-4384-8ee3-9408ee3fff9e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2274ca0d-d04b-449d-adad-cbb9035d7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-d38edccf-cb1c-4fa3-871c-f960d256b507-45733f88-b88c-421d-9d1b-884b1415e839" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Creating volume 45733f88-b88c-421d-9d1b-884b1415e839 from snapshot d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-quobyte-45733f88-b88c-421d-9d1b-884b1415e839" by "_copy_volume_from_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:17 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Volume volume-0bafd288-b979-4384-8ee3-9408ee3fff9e (0bafd288-b979-4384-8ee3-9408ee3fff9e): created successfully Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2274ca0d-d04b-449d-adad-cbb9035d7a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (4d6bca2f-ec6f-43b3-acca-a9b1f9737177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-45733f88-b88c-421d-9d1b-884b1415e839" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] snapshot: d38edccf-cb1c-4fa3-871c-f960d256b507, volume: 45733f88-b88c-421d-9d1b-884b1415e839, {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 03 18:42:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-ffa7ba8f-5889-4c7f-b668-af5417b67b37 tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4982af3b-f350-4d4d-8c2f-3a97299dcb9e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:17 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 Nov 03 18:42:17 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:18 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507" returned: 0 in 0.365s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44fa4ef5-bd28-4255-9757-37350932a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a03291e-e4f0-4767-83d8-f473e8bdc8c5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:18 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e Nov 03 18:42:18 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:18 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Creating direct copy from snapshot {{(pid=86841) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG cinder.utils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Path /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 not found in is_blk_device check {{(pid=86841) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 03 18:42:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:18 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 Nov 03 18:42:18 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:24 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839" returned: 0 in 6.174s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:24 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Image conversion details: src /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 {{(pid=86841) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 03 18:42:24 devstack cinder-volume[86841]: INFO cinder.image.image_utils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Converted 1024.00 MB image at 165.80 MB/s Nov 03 18:42:24 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 is being set with open permissions: ugo+rw Nov 03 18:42:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:24 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 Nov 03 18:42:24 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:25 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-45733f88-b88c-421d-9d1b-884b1415e839" released by "_copy_volume_from_snapshot" :: held 7.216s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-d38edccf-cb1c-4fa3-871c-f960d256b507-45733f88-b88c-421d-9d1b-884b1415e839" released by "_create_volume_from_snapshot" :: held 7.302s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.338s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.826s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Creating offline snapshot d074c745-41ba-4447-b653-eea89d3aec54 of volume 0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7d1100-2085-4d61-9b65-06c4276fb1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45733f88-b88c-421d-9d1b-884b1415e839', 'volume_size': 1, 'snapshot_id': 'd38edccf-cb1c-4fa3-871c-f960d256b507'}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5addf40-520b-4a65-a8ed-e2298ff72e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b6a72-151f-443c-8b4f-036becf6bb67]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:25 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Volume volume-45733f88-b88c-421d-9d1b-884b1415e839 (45733f88-b88c-421d-9d1b-884b1415e839): created successfully Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5addf40-520b-4a65-a8ed-e2298ff72e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Flow 'volume_create_manager' (751cd8e4-e2eb-47cd-b925-1b6dc0bcfcd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:25 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-412ad741-0a2b-4faa-bad3-5b55c64c58a8 tempest-SnapshotDependencyTests-272894516 None] Created volume successfully. Nov 03 18:42:25 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e Nov 03 18:42:25 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:25 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e" returned: 0 in 0.353s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:25 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 1G Nov 03 18:42:25 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:25 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 1G" returned: 0 in 0.374s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bafd288-b979-4384-8ee3-9408ee3fff9e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:25 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bafd288-b979-4384-8ee3-9408ee3fff9e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 Nov 03 18:42:25 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:26 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bafd288-b979-4384-8ee3-9408ee3fff9e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54" returned: 0 in 0.287s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:26 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 is being set with open permissions: ugo+rw Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:26 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 Nov 03 18:42:26 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-d38edccf-cb1c-4fa3-871c-f960d256b507-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-d38edccf-cb1c-4fa3-871c-f960d256b507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-quobyte-44fa4ef5-bd28-4255-9757-37350932a72e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-44fa4ef5-bd28-4255-9757-37350932a72e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-quobyte-d38edccf-cb1c-4fa3-871c-f960d256b507" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-d38edccf-cb1c-4fa3-871c-f960d256b507" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Deleting offline snapshot d38edccf-cb1c-4fa3-871c-f960d256b507 of volume 44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] snapshot_file for this snap is: volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[618eb19c-ec42-43ce-b272-a1936cd58bd4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:26 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54" returned: 0 in 0.251s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:26 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 Nov 03 18:42:26 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:26 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info Nov 03 18:42:26 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:26 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info" returned: 0 in 0.259s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:26 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info is being set with open permissions: ugo+rw Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:26 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507" returned: 0 in 0.363s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44fa4ef5-bd28-4255-9757-37350932a72e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:26 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info Nov 03 18:42:26 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd82524d-dcc2-419d-80fb-40848a11856d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:26 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e Nov 03 18:42:26 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:26 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.info" returned: 0 in 0.243s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-aa9b703c-1507-44eb-8d1f-90ab38ef714e tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:42:27 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e" returned: 0 in 0.523s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:27 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 Nov 03 18:42:27 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:27 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-d074c745-41ba-4447-b653-eea89d3aec54-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Lock "cinder-d074c745-41ba-4447-b653-eea89d3aec54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-0bafd288-b979-4384-8ee3-9408ee3fff9e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:27 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507 Nov 03 18:42:27 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-0bafd288-b979-4384-8ee3-9408ee3fff9e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-d074c745-41ba-4447-b653-eea89d3aec54" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-d074c745-41ba-4447-b653-eea89d3aec54" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot d074c745-41ba-4447-b653-eea89d3aec54 of volume 0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bfc4ef-bf34-42d5-a880-a18c8f848ab1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:27 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 Nov 03 18:42:27 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:27 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e.d38edccf-cb1c-4fa3-871c-f960d256b507" returned: 0 in 0.268s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-d38edccf-cb1c-4fa3-871c-f960d256b507" released by "_delete_snapshot" :: held 1.625s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-44fa4ef5-bd28-4255-9757-37350932a72e" released by "delete_snapshot" :: held 1.655s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:27 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Created reservations ['57ae5b37-7a9e-43c3-bed9-f40731b1c6cc', 'af9b582e-2148-42a5-b85e-1be8fafe9ed4', '847ac3f4-2b13-425f-b008-ca6c43259e94', '860f16c0-2c27-4ffa-92ad-1d1b00e83b84'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:28 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Delete snapshot completed successfully. Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d5e7a913-d44f-4303-8f72-1d5cf935a974 tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-d38edccf-cb1c-4fa3-871c-f960d256b507-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:28 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bafd288-b979-4384-8ee3-9408ee3fff9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441e0ea-786f-49d6-b110-82341a1bce50]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:28 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e Nov 03 18:42:28 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-44fa4ef5-bd28-4255-9757-37350932a72e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-44fa4ef5-bd28-4255-9757-37350932a72e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-quobyte-44fa4ef5-bd28-4255-9757-37350932a72e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-44fa4ef5-bd28-4255-9757-37350932a72e" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:28 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e" returned: 0 in 0.397s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2df3d8-ad0d-4193-bacc-abd72bebdd99]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:28 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 Nov 03 18:42:28 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:28 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e Nov 03 18:42:28 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:28 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54" returned: 0 in 0.325s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:28 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54 Nov 03 18:42:28 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:28 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e" returned: 0 in 0.375s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:28 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e Nov 03 18:42:28 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:29 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e.d074c745-41ba-4447-b653-eea89d3aec54" returned: 0 in 0.254s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-d074c745-41ba-4447-b653-eea89d3aec54" released by "_delete_snapshot" :: held 1.444s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-0bafd288-b979-4384-8ee3-9408ee3fff9e" released by "delete_snapshot" :: held 1.467s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:29 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-44fa4ef5-bd28-4255-9757-37350932a72e" returned: 0 in 0.261s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-44fa4ef5-bd28-4255-9757-37350932a72e" released by "delete_volume" :: held 0.699s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Created reservations ['90e72129-508e-4e71-8d3b-7343961ac346', '2c893c0b-76aa-4302-bae9-974b2364efa4', 'e135492c-277a-4f06-8cab-9309aff9596b', 'e4d0b696-6f2b-4657-9924-cae3b3669f18'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Created reservations ['c29bb253-20bf-44ef-a554-f8ca7ff36592', '5c9f0e1e-99bc-4b8a-b315-8605c72af900', '747f9310-f570-4c99-a13d-42826a1f8c2a', '26eb9015-b2b3-4fbf-9628-162237ab0822'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-044a1580-fb96-4d97-83a8-e4037e81f76a tempest-ProjectMemberTests-653481150 None] Lock "cinder-d074c745-41ba-4447-b653-eea89d3aec54-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:29 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:29 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:29 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.245s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-45733f88-b88c-421d-9d1b-884b1415e839-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:29 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Deleted volume successfully. Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-45733f88-b88c-421d-9d1b-884b1415e839-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4a7245c5-0ee8-41ab-8894-74f498670a2f tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-44fa4ef5-bd28-4255-9757-37350932a72e-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "cinder-quobyte-45733f88-b88c-421d-9d1b-884b1415e839" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-45733f88-b88c-421d-9d1b-884b1415e839" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f535a330-ece6-4b4c-82fa-e90ec25a997e]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-0bafd288-b979-4384-8ee3-9408ee3fff9e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Lock "cinder-0bafd288-b979-4384-8ee3-9408ee3fff9e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:29 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 Nov 03 18:42:29 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-0bafd288-b979-4384-8ee3-9408ee3fff9e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-0bafd288-b979-4384-8ee3-9408ee3fff9e" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7376e1b-9752-42bd-ab8a-8f43fdbf00a8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:29 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e Nov 03 18:42:29 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:30 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839" returned: 0 in 0.381s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:30 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839 Nov 03 18:42:30 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:30 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e" returned: 0 in 0.364s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:30 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e Nov 03 18:42:30 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:30 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-45733f88-b88c-421d-9d1b-884b1415e839" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-quobyte-45733f88-b88c-421d-9d1b-884b1415e839" released by "delete_volume" :: held 0.685s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Created reservations ['087b6eb6-39f0-4c35-ab47-a915fccefdb9', '46b3af07-0fe1-4f33-be12-d8dd672a9948', '0fdbc682-f922-44d2-8c4a-eb1c70139933', '24853ab4-d7bd-4b07-8bc8-637ce6ce9083'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:30 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:30 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:30 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-0bafd288-b979-4384-8ee3-9408ee3fff9e" returned: 0 in 0.266s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-0bafd288-b979-4384-8ee3-9408ee3fff9e" released by "delete_volume" :: held 0.697s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Created reservations ['1df78dd3-6a6d-48e2-a543-27443d4ad22c', '33584759-ed74-4b0e-98df-e546b0e6ac8d', '045ac608-5bfc-404c-9e12-79631efa64fd', '1201ca65-99a7-48f3-a27d-16cf5257e42b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:30 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:30 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:30 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Deleted volume successfully. Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-afa02660-6ac6-456e-a2a3-ee5e4a2f70ee tempest-SnapshotDependencyTests-272894516 None] Lock "cinder-45733f88-b88c-421d-9d1b-884b1415e839-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:30 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.276s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:42:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-947fe337-f9bd-4d94-9bef-5a1da6bda515 tempest-ProjectMemberTests-653481150 None] Lock "cinder-0bafd288-b979-4384-8ee3-9408ee3fff9e-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (73984769-ce2e-4031-a91b-e39449431532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc83735-142a-4acb-894c-1bc0e645be4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc83735-142a-4acb-894c-1bc0e645be4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288188587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e111bcb5-a431-4713-a91b-ed536a0e11c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:31Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4db248-3c29-477d-a8e9-591f2ae7e1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4db248-3c29-477d-a8e9-591f2ae7e1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4183a29-6a72-4825-99aa-eada6f3247d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4183a29-6a72-4825-99aa-eada6f3247d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e111bcb5-a431-4713-a91b-ed536a0e11c6', 'volume_name': 'volume-e111bcb5-a431-4713-a91b-ed536a0e11c6', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce9e384-0420-4036-9bde-7ce1fba280b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce9e384-0420-4036-9bde-7ce1fba280b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0789203d-96c2-4d48-92b5-2a2d6c80a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:31 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Volume e111bcb5-a431-4713-a91b-ed536a0e11c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e111bcb5-a431-4713-a91b-ed536a0e11c6', 'volume_size': 1} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288188587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e111bcb5-a431-4713-a91b-ed536a0e11c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:31Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Creating volume e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:31 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:31 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 1073741824 Nov 03 18:42:31 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:31 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 1073741824" returned: 0 in 0.484s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:32 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 Nov 03 18:42:32 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:32 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0789203d-96c2-4d48-92b5-2a2d6c80a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e111bcb5-a431-4713-a91b-ed536a0e11c6', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6824772-6c35-4fab-913d-64bffdfb8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:32 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Volume volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 (e111bcb5-a431-4713-a91b-ed536a0e11c6): created successfully Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6824772-6c35-4fab-913d-64bffdfb8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:32 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (73984769-ce2e-4031-a91b-e39449431532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:32 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-acfab68c-7a36-491e-b66c-936cbb3bd033 tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:42:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Creating offline snapshot 510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 of volume e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:33 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0171f-9e6a-44b8-8720-cc22401cb48b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:33 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 Nov 03 18:42:33 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:33 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:34 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 1G Nov 03 18:42:34 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:34 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 1G" returned: 0 in 0.454s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:34 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 Nov 03 18:42:34 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:34 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" returned: 0 in 0.311s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:34 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 is being set with open permissions: ugo+rw Nov 03 18:42:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:34 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 Nov 03 18:42:34 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:35 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" returned: 0 in 0.275s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:35 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info Nov 03 18:42:35 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:35 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info" returned: 0 in 0.255s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:35 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info is being set with open permissions: ugo+rw Nov 03 18:42:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:35 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info Nov 03 18:42:35 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:35 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.info" returned: 0 in 0.242s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:35 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-69a8a54c-e99c-4ff9-87dc-f734d1c3392b tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-510a4b92-0cb0-47a2-92d4-ef9d4ff96b77-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Lock "cinder-510a4b92-0cb0-47a2-92d4-ef9d4ff96b77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-e111bcb5-a431-4713-a91b-ed536a0e11c6" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-e111bcb5-a431-4713-a91b-ed536a0e11c6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot 510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 of volume e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5ef618-c6d3-4b57-99e5-cb3c281d0255]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:36 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 Nov 03 18:42:36 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:37 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" returned: 0 in 0.418s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e111bcb5-a431-4713-a91b-ed536a0e11c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:37 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1c80b8-1b93-41e7-b313-2837f6b73d9f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:37 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 Nov 03 18:42:37 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:37 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6" returned: 0 in 0.367s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:37 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 Nov 03 18:42:37 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:38 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" returned: 0 in 0.331s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:38 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77 Nov 03 18:42:38 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:38 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6.510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" returned: 0 in 0.305s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-510a4b92-0cb0-47a2-92d4-ef9d4ff96b77" released by "_delete_snapshot" :: held 1.552s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-e111bcb5-a431-4713-a91b-ed536a0e11c6" released by "delete_snapshot" :: held 1.580s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Created reservations ['c36e8864-1b2b-49d1-84db-08c652152f6e', 'ba3810d1-1444-47be-b876-e36f4c5f6cad', 'c48a7a03-7962-4b7f-919a-75437c980845', '8fe501cf-49a9-4cbc-bf8b-c01b375fbf55'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-7b7c2ae6-ad70-4fb0-a31a-c5e77d65dfcc tempest-ProjectMemberTests-653481150 None] Lock "cinder-510a4b92-0cb0-47a2-92d4-ef9d4ff96b77-delete_snapshot" released by "delete_snapshot" :: held 1.736s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-e111bcb5-a431-4713-a91b-ed536a0e11c6-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Lock "cinder-e111bcb5-a431-4713-a91b-ed536a0e11c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-e111bcb5-a431-4713-a91b-ed536a0e11c6" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-e111bcb5-a431-4713-a91b-ed536a0e11c6" acquired by "delete_volume" :: waited 0.021s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de08c8c-5de9-48e3-b341-2fc0c745e0e8]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:39 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 Nov 03 18:42:39 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:39 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6" returned: 0 in 0.381s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:39 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6 Nov 03 18:42:39 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:39 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-e111bcb5-a431-4713-a91b-ed536a0e11c6" returned: 0 in 0.270s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-e111bcb5-a431-4713-a91b-ed536a0e11c6" released by "delete_volume" :: held 0.718s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Created reservations ['d7a312c0-5073-44f9-bce4-1299e9872c23', '85768712-dbf6-43fe-ab5b-512f798def9b', 'c55e6dce-b64d-403f-9d69-355f6c5d1f31', '659a3e2d-4d19-4f37-8987-c711de0d7a8e'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:39 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:39 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:40 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:40 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-63e049b4-3227-49cb-9da1-ddb70ea52f11 tempest-ProjectMemberTests-653481150 None] Lock "cinder-e111bcb5-a431-4713-a91b-ed536a0e11c6-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (7119ddab-b80e-4fb4-8083-a3d227f81bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66844ef0-9ea9-4982-8a15-539f51f16689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66844ef0-9ea9-4982-8a15-539f51f16689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2019827687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b38e82-6c37-431f-a1e3-d1281caf7b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:41Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8efc982-0c2b-4af9-ae0c-6d311e45a911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8efc982-0c2b-4af9-ae0c-6d311e45a911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32f7125-f5c7-4ce0-aef4-cf194c4f61c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a32f7125-f5c7-4ce0-aef4-cf194c4f61c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b38e82-6c37-431f-a1e3-d1281caf7b15', 'volume_name': 'volume-91b38e82-6c37-431f-a1e3-d1281caf7b15', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bddecc1-c5e5-4855-8b2a-07ad8e832599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bddecc1-c5e5-4855-8b2a-07ad8e832599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b980e265-f0c8-4e62-ad03-d28ab6ad549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:40 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Volume 91b38e82-6c37-431f-a1e3-d1281caf7b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b38e82-6c37-431f-a1e3-d1281caf7b15', 'volume_size': 1} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2019827687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b38e82-6c37-431f-a1e3-d1281caf7b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:41Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Creating volume 91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:40 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:40 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 1073741824 Nov 03 18:42:40 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:41 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 1073741824" returned: 0 in 0.466s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:41 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 Nov 03 18:42:41 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:41 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15" returned: 0 in 0.255s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b980e265-f0c8-4e62-ad03-d28ab6ad549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b38e82-6c37-431f-a1e3-d1281caf7b15', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87954ad0-f3b1-488f-8c9e-9159031691dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Volume volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 (91b38e82-6c37-431f-a1e3-d1281caf7b15): created successfully Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87954ad0-f3b1-488f-8c9e-9159031691dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (7119ddab-b80e-4fb4-8083-a3d227f81bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-129dde56-adef-48d2-9bc5-6922e2de36b2 tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:42:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Creating offline snapshot 20f1fb95-563c-4eca-aa0c-983ee5bac988 of volume 91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:42 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec41e3d-bcb8-4d3d-b577-7a8df84cfcd0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:42 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 Nov 03 18:42:42 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:43 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15" returned: 0 in 0.352s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:43 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 1G Nov 03 18:42:43 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:43 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 1G" returned: 0 in 0.386s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:43 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 Nov 03 18:42:43 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:43 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988" returned: 0 in 0.290s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:43 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 is being set with open permissions: ugo+rw Nov 03 18:42:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:43 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 Nov 03 18:42:43 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:44 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=147,cinder:UPDATE=195,cinder:INSERT=51,cinder:DELETE=15 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=134,cinder:UPDATE=176,cinder:INSERT=44,cinder:DELETE=17 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:44 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info Nov 03 18:42:44 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:44 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info" returned: 0 in 0.246s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:44 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info is being set with open permissions: ugo+rw Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:44 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info Nov 03 18:42:44 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:44 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.info" returned: 0 in 0.239s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c1a74bd6-2c88-4457-983e-853a6cd40f36 tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-20f1fb95-563c-4eca-aa0c-983ee5bac988-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Lock "cinder-20f1fb95-563c-4eca-aa0c-983ee5bac988-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-91b38e82-6c37-431f-a1e3-d1281caf7b15" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-91b38e82-6c37-431f-a1e3-d1281caf7b15" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-20f1fb95-563c-4eca-aa0c-983ee5bac988" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-20f1fb95-563c-4eca-aa0c-983ee5bac988" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot 20f1fb95-563c-4eca-aa0c-983ee5bac988 of volume 91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6bda07-540f-4599-ade5-d5424992ff60]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:45 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 Nov 03 18:42:45 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:45 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91b38e82-6c37-431f-a1e3-d1281caf7b15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ee37d2-ccbb-4dd6-9e97-09bfdf3617d1]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:45 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 Nov 03 18:42:45 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:45 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15" returned: 0 in 0.349s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:45 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 Nov 03 18:42:45 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:46 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988" returned: 0 in 0.332s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:46 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988 Nov 03 18:42:46 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:46 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15.20f1fb95-563c-4eca-aa0c-983ee5bac988" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-20f1fb95-563c-4eca-aa0c-983ee5bac988" released by "_delete_snapshot" :: held 1.362s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-91b38e82-6c37-431f-a1e3-d1281caf7b15" released by "delete_snapshot" :: held 1.385s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Created reservations ['6a83ff75-4374-4c77-a8e5-a651ccf1ed9b', '6f2a383b-0979-4aa1-a481-6b5b9ec83f90', '16b972f0-35a9-4fe3-af3b-a8239eb9fd54', 'f3ede0ad-291c-411a-8448-358ea77eceea'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:46 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:42:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-dd48df3f-0629-46b1-8b9b-4e9682913080 tempest-ProjectMemberTests-653481150 None] Lock "cinder-20f1fb95-563c-4eca-aa0c-983ee5bac988-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-91b38e82-6c37-431f-a1e3-d1281caf7b15-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-91b38e82-6c37-431f-a1e3-d1281caf7b15-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-91b38e82-6c37-431f-a1e3-d1281caf7b15" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-91b38e82-6c37-431f-a1e3-d1281caf7b15" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[7394461a-fc1a-4ab2-958f-599db78abbd5]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:47 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 Nov 03 18:42:47 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:47 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:47 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15 Nov 03 18:42:47 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:47 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-91b38e82-6c37-431f-a1e3-d1281caf7b15" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-91b38e82-6c37-431f-a1e3-d1281caf7b15" released by "delete_volume" :: held 0.643s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Created reservations ['d578fc1e-061d-42b1-8589-437aa2931093', 'c76a568f-f75e-4e6e-a6cc-748a960298a1', 'c69ccdc9-5d1b-4727-9900-79fbe0bcdbc8', '860ad8b9-b6c1-4bcc-bc27-a010090d97e8'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:47 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:47 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:48 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.235s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:48 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-98d4fbe6-4f47-4378-be09-77374bf672a8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-91b38e82-6c37-431f-a1e3-d1281caf7b15-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (e52b5237-8597-478c-aa91-abe3a44875af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2304e5fa-375e-4ee9-bc04-d2adb04a27f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2304e5fa-375e-4ee9-bc04-d2adb04a27f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799790342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b14d822-2543-4a43-bc20-50386e263813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:49Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e1f69-8051-40a6-ba34-0cead5bfeb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e1f69-8051-40a6-ba34-0cead5bfeb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d1a15c-b2ef-4a2f-939b-0b989f48c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d1a15c-b2ef-4a2f-939b-0b989f48c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b14d822-2543-4a43-bc20-50386e263813', 'volume_name': 'volume-4b14d822-2543-4a43-bc20-50386e263813', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2cc3b-3ea7-4912-a7fe-07f59c711312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb2cc3b-3ea7-4912-a7fe-07f59c711312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c7b7b7-1500-48d9-9384-867ad930bf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:48 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Volume 4b14d822-2543-4a43-bc20-50386e263813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b14d822-2543-4a43-bc20-50386e263813', 'volume_size': 1} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799790342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b14d822-2543-4a43-bc20-50386e263813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:49Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Creating volume 4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:48 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:48 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:48 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 1073741824 Nov 03 18:42:48 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:49 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 1073741824" returned: 0 in 0.403s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:49 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 Nov 03 18:42:49 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:49 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813" returned: 0 in 0.239s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c7b7b7-1500-48d9-9384-867ad930bf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b14d822-2543-4a43-bc20-50386e263813', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8223db-5b87-43b9-a86d-d3ebd7c8b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:49 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Volume volume-4b14d822-2543-4a43-bc20-50386e263813 (4b14d822-2543-4a43-bc20-50386e263813): created successfully Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8223db-5b87-43b9-a86d-d3ebd7c8b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (e52b5237-8597-478c-aa91-abe3a44875af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:49 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6b8a2150-3d72-4f5d-96ee-a3af397c0085 tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Creating offline snapshot 159ebaaf-5156-4fa5-bbf3-7c171f9f617b of volume 4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b177d3e-63cf-4217-9132-1293269d3d47]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:49 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:49 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 Nov 03 18:42:49 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:50 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813" returned: 0 in 0.357s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:50 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b 1G Nov 03 18:42:50 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:50 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b 1G" returned: 0 in 0.376s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b14d822-2543-4a43-bc20-50386e263813 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:50 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b14d822-2543-4a43-bc20-50386e263813 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b Nov 03 18:42:50 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:50 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b14d822-2543-4a43-bc20-50386e263813 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b" returned: 0 in 0.319s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:50 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b is being set with open permissions: ugo+rw Nov 03 18:42:50 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:50 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b Nov 03 18:42:50 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:51 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:51 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info Nov 03 18:42:51 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:51 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:51 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info is being set with open permissions: ugo+rw Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:51 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info Nov 03 18:42:51 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:51 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.info" returned: 0 in 0.260s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:51 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d147ee99-c46e-4f02-a50f-7062d3f4c7a9 tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:42:51 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-159ebaaf-5156-4fa5-bbf3-7c171f9f617b-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Lock "cinder-159ebaaf-5156-4fa5-bbf3-7c171f9f617b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-4b14d822-2543-4a43-bc20-50386e263813" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4b14d822-2543-4a43-bc20-50386e263813" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-159ebaaf-5156-4fa5-bbf3-7c171f9f617b" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-159ebaaf-5156-4fa5-bbf3-7c171f9f617b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot 159ebaaf-5156-4fa5-bbf3-7c171f9f617b of volume 4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[507f510b-a954-4cd6-8574-a268f6203957]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:52 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b Nov 03 18:42:52 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:52 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b14d822-2543-4a43-bc20-50386e263813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5d3ed1-e32e-412f-b450-ceb4453237f4]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:52 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 Nov 03 18:42:52 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:52 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:52 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:52 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b Nov 03 18:42:52 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:53 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b" returned: 0 in 0.336s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:53 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b Nov 03 18:42:53 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:53 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813.159ebaaf-5156-4fa5-bbf3-7c171f9f617b" returned: 0 in 0.240s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-159ebaaf-5156-4fa5-bbf3-7c171f9f617b" released by "_delete_snapshot" :: held 1.371s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4b14d822-2543-4a43-bc20-50386e263813" released by "delete_snapshot" :: held 1.391s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Created reservations ['435c94c2-5a67-4dcb-8c4a-94636b140d45', 'ac4ecb05-18c2-4ce8-9ac8-5f9e620917a6', '9aaebe4a-7a86-4dd9-8d5e-b126937b42c3', '91ed0aa1-5c19-4a3d-abfa-ab663e5b617b'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:53 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:42:53 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-b4ee8a08-765b-460c-937f-1a0b72c6829d tempest-ProjectMemberTests-653481150 None] Lock "cinder-159ebaaf-5156-4fa5-bbf3-7c171f9f617b-delete_snapshot" released by "delete_snapshot" :: held 1.560s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-4b14d822-2543-4a43-bc20-50386e263813-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Lock "cinder-4b14d822-2543-4a43-bc20-50386e263813-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-4b14d822-2543-4a43-bc20-50386e263813" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4b14d822-2543-4a43-bc20-50386e263813" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbf90d0-ac9b-48b6-a26e-2f4b38fd9164]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:54 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 Nov 03 18:42:54 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:54 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813" returned: 0 in 0.343s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:54 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813 Nov 03 18:42:54 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:54 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-4b14d822-2543-4a43-bc20-50386e263813" returned: 0 in 0.240s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-4b14d822-2543-4a43-bc20-50386e263813" released by "delete_volume" :: held 0.644s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Created reservations ['51acfeb7-c864-4671-bfa6-33398eb30cad', 'c71a94e5-7601-4e3b-8e47-2eff24d30c5b', 'f7e30d28-449b-4176-8d5a-d37a9fa28748', '3c06e9c4-5a21-46f7-b6a6-bb84c508323a'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:54 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:54 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:54 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:55 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:55 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-d2a62f1a-ceec-484c-88ae-43f49672f66e tempest-ProjectMemberTests-653481150 None] Lock "cinder-4b14d822-2543-4a43-bc20-50386e263813-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (01b8c1da-e2fc-4176-bd35-6a2e7270b31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8558485-1adc-43c4-8a6a-104138dc2c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8558485-1adc-43c4-8a6a-104138dc2c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891005114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8e0a31-282e-4ddd-a2b5-853319a82312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:56Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4b1dcf-a457-493e-bf8a-c4fe21694078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4b1dcf-a457-493e-bf8a-c4fe21694078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db34f8aa-eb39-4a66-a80d-ac164d28ed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db34f8aa-eb39-4a66-a80d-ac164d28ed04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8e0a31-282e-4ddd-a2b5-853319a82312', 'volume_name': 'volume-9a8e0a31-282e-4ddd-a2b5-853319a82312', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de70dd3d-ad32-4a45-aefb-83ba9991623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de70dd3d-ad32-4a45-aefb-83ba9991623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7ca365-c7bd-433b-9b47-94ae3b33407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:55 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Volume 9a8e0a31-282e-4ddd-a2b5-853319a82312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8e0a31-282e-4ddd-a2b5-853319a82312', 'volume_size': 1} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-891005114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8e0a31-282e-4ddd-a2b5-853319a82312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:42:56Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Creating volume 9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:42:55 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:42:55 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:55 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 1073741824 Nov 03 18:42:55 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:56 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 1073741824" returned: 0 in 0.422s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:56 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 Nov 03 18:42:56 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:56 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312" returned: 0 in 0.273s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7ca365-c7bd-433b-9b47-94ae3b33407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8e0a31-282e-4ddd-a2b5-853319a82312', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2713c7ad-2ecf-4be9-a125-a73864d801a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:42:56 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Volume volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 (9a8e0a31-282e-4ddd-a2b5-853319a82312): created successfully Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2713c7ad-2ecf-4be9-a125-a73864d801a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (01b8c1da-e2fc-4176-bd35-6a2e7270b31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:42:56 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-bb750ac5-a32e-411a-9250-6893fe42ffcb tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Creating offline snapshot 3d08c7da-e03a-473c-9d19-1d4d7e3feace of volume 9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc029cd2-78ab-46a1-b1bf-aa1b70bcf080]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:56 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:57 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 Nov 03 18:42:57 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:57 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312" returned: 0 in 0.360s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:57 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace 1G Nov 03 18:42:57 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:57 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace 1G" returned: 0 in 0.397s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:57 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace Nov 03 18:42:57 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:57 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace" returned: 0 in 0.300s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:57 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace is being set with open permissions: ugo+rw Nov 03 18:42:57 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:58 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace Nov 03 18:42:58 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:58 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:58 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info Nov 03 18:42:58 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:58 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info" returned: 0 in 0.258s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:58 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info is being set with open permissions: ugo+rw Nov 03 18:42:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:58 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info Nov 03 18:42:58 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:58 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.info" returned: 0 in 0.235s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:58 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:58 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-fe0e3968-61af-4c65-88ca-0d07b1f34f16 tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-3d08c7da-e03a-473c-9d19-1d4d7e3feace-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Lock "cinder-3d08c7da-e03a-473c-9d19-1d4d7e3feace-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-9a8e0a31-282e-4ddd-a2b5-853319a82312" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-9a8e0a31-282e-4ddd-a2b5-853319a82312" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-3d08c7da-e03a-473c-9d19-1d4d7e3feace" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-3d08c7da-e03a-473c-9d19-1d4d7e3feace" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot 3d08c7da-e03a-473c-9d19-1d4d7e3feace of volume 9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a04dd7-4407-4aaa-be54-f8e731ebcf46]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:59 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace Nov 03 18:42:59 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:59 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace" returned: 0 in 0.364s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a8e0a31-282e-4ddd-a2b5-853319a82312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bcf641-f202-48d4-aa5d-a43ecc722940]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:59 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:42:59 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:59 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 Nov 03 18:42:59 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:42:59 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.246s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 03 18:42:59 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312" returned: 0 in 0.371s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:42:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:42:59 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace Nov 03 18:42:59 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:00 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace" returned: 0 in 0.323s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:00 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace Nov 03 18:43:00 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:00 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312.3d08c7da-e03a-473c-9d19-1d4d7e3feace" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-3d08c7da-e03a-473c-9d19-1d4d7e3feace" released by "_delete_snapshot" :: held 1.402s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-9a8e0a31-282e-4ddd-a2b5-853319a82312" released by "delete_snapshot" :: held 1.425s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Created reservations ['38d8797c-f688-4dbc-bb15-92b52a3ed437', '1c5693d6-52b3-40a5-9e6c-e06d0c459440', '4d394ef1-fa4b-4124-95bd-efc30874d31c', 'da2b1875-42cc-42bf-a2c8-74df4f203047'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:00 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:43:00 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-578bea13-9c54-4360-939b-b7152333d313 tempest-ProjectMemberTests-653481150 None] Lock "cinder-3d08c7da-e03a-473c-9d19-1d4d7e3feace-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-9a8e0a31-282e-4ddd-a2b5-853319a82312-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-9a8e0a31-282e-4ddd-a2b5-853319a82312-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-9a8e0a31-282e-4ddd-a2b5-853319a82312" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-9a8e0a31-282e-4ddd-a2b5-853319a82312" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47908a6-2dca-4942-9757-14f0c8f6ca31]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:01 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 Nov 03 18:43:01 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:01 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:01 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312 Nov 03 18:43:01 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:01 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-9a8e0a31-282e-4ddd-a2b5-853319a82312" returned: 0 in 0.246s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-9a8e0a31-282e-4ddd-a2b5-853319a82312" released by "delete_volume" :: held 0.660s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:01 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Created reservations ['52317fa8-693c-4889-a7be-bfe97d535d0a', '44f828a4-a6f5-45fd-9881-0cb5e98469fc', '2218a298-76a2-4200-862b-f99adce5a04b', '98da62a2-ec87-456f-afe3-145c2b8a4466'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:02 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:02 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:02 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.247s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:02 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-8e3e4a6f-fdcb-49be-b0ed-742e3252a0c8 tempest-ProjectMemberTests-653481150 None] Lock "cinder-9a8e0a31-282e-4ddd-a2b5-853319a82312-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (619c8c41-2149-43c6-8f41-f4b9f8899871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310d2f00-eea3-495f-a8b4-9bb09f0e7fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310d2f00-eea3-495f-a8b4-9bb09f0e7fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805194815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b71603e-9a87-4766-8760-9409235acb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:03Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f751ec57-effa-4f56-b688-73e0c2c502ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f751ec57-effa-4f56-b688-73e0c2c502ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54c65e4-82fd-4298-b190-f82d48883314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e54c65e4-82fd-4298-b190-f82d48883314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b71603e-9a87-4766-8760-9409235acb84', 'volume_name': 'volume-1b71603e-9a87-4766-8760-9409235acb84', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a289e04-6686-4dc2-8bd2-79d31907d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a289e04-6686-4dc2-8bd2-79d31907d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfc3b02-b27f-4f28-93ed-6d9f83c867b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:02 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Volume 1b71603e-9a87-4766-8760-9409235acb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b71603e-9a87-4766-8760-9409235acb84', 'volume_size': 1} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805194815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b71603e-9a87-4766-8760-9409235acb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3168f9280e744645beb4ffb172239bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:03Z,use_quota=True,user_id='e2945475d7dc48c0bded3a4a215c8504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Creating volume 1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:43:02 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:43:02 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:02 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 1073741824 Nov 03 18:43:02 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:03 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 1073741824" returned: 0 in 0.409s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:03 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 Nov 03 18:43:03 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:03 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84" returned: 0 in 0.245s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfc3b02-b27f-4f28-93ed-6d9f83c867b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b71603e-9a87-4766-8760-9409235acb84', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b404c4-778a-49cb-9d46-69eec8f6886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:03 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Volume volume-1b71603e-9a87-4766-8760-9409235acb84 (1b71603e-9a87-4766-8760-9409235acb84): created successfully Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4b404c4-778a-49cb-9d46-69eec8f6886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Flow 'volume_create_manager' (619c8c41-2149-43c6-8f41-f4b9f8899871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:03 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-735683d2-4833-4b47-9439-ca5d37a6e16b tempest-ProjectMemberTests-653481150 None] Created volume successfully. Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Creating offline snapshot deb29021-cf44-4969-b554-b9801fbe56ab of volume 1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0ba3f-ea3d-46d8-b72b-5f8fef36b7ec]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:03 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:04 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 Nov 03 18:43:04 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:04 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:04 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab 1G Nov 03 18:43:04 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:04 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab 1G" returned: 0 in 0.382s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b71603e-9a87-4766-8760-9409235acb84 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:04 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b71603e-9a87-4766-8760-9409235acb84 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab Nov 03 18:43:04 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:04 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b71603e-9a87-4766-8760-9409235acb84 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab" returned: 0 in 0.286s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:04 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab is being set with open permissions: ugo+rw Nov 03 18:43:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:04 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab Nov 03 18:43:04 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:05 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:05 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info Nov 03 18:43:05 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:05 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info" returned: 0 in 0.243s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:05 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info is being set with open permissions: ugo+rw Nov 03 18:43:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:05 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info Nov 03 18:43:05 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:05 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.info" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:05 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-6df55410-1f0d-4406-a940-04aaa1cd137d tempest-ProjectMemberTests-653481150 None] Create snapshot completed successfully Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-deb29021-cf44-4969-b554-b9801fbe56ab-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Lock "cinder-deb29021-cf44-4969-b554-b9801fbe56ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-1b71603e-9a87-4766-8760-9409235acb84" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-1b71603e-9a87-4766-8760-9409235acb84" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-deb29021-cf44-4969-b554-b9801fbe56ab" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-deb29021-cf44-4969-b554-b9801fbe56ab" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Deleting offline snapshot deb29021-cf44-4969-b554-b9801fbe56ab of volume 1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] snapshot_file for this snap is: volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[348acefa-fd14-4533-a147-5f5c95c6ba63]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:06 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab Nov 03 18:43:06 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:06 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b71603e-9a87-4766-8760-9409235acb84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb2203-3a79-4498-96cd-e7dc108a6fb0]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:06 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 Nov 03 18:43:06 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:06 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84" returned: 0 in 0.361s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:06 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab Nov 03 18:43:06 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:07 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab" returned: 0 in 0.327s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:07 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab Nov 03 18:43:07 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:07 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84.deb29021-cf44-4969-b554-b9801fbe56ab" returned: 0 in 0.240s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-deb29021-cf44-4969-b554-b9801fbe56ab" released by "_delete_snapshot" :: held 1.372s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-1b71603e-9a87-4766-8760-9409235acb84" released by "delete_snapshot" :: held 1.395s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Created reservations ['67533bc1-9b15-4ba5-a6bc-197c8f334c56', '9f04f56a-b36a-425a-acdb-75cdf3d0777c', '07fe1790-fc41-4fe2-9fa1-b67c6be48d1f', 'f18fb3a5-e4e3-4f39-bb54-dea9ee1c85d5'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:07 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Delete snapshot completed successfully. Nov 03 18:43:07 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-571d3012-61a9-4669-8ed0-0c2518e1f90d tempest-ProjectMemberTests-653481150 None] Lock "cinder-deb29021-cf44-4969-b554-b9801fbe56ab-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-1b71603e-9a87-4766-8760-9409235acb84-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Lock "cinder-1b71603e-9a87-4766-8760-9409235acb84-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Acquiring lock "cinder-quobyte-1b71603e-9a87-4766-8760-9409235acb84" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-1b71603e-9a87-4766-8760-9409235acb84" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[467c3ad2-c966-424f-98c6-3632677d1e8d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:08 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 Nov 03 18:43:08 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:08 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84" returned: 0 in 0.348s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:08 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84 Nov 03 18:43:08 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:08 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:08 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1b71603e-9a87-4766-8760-9409235acb84" returned: 0 in 0.239s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Lock "cinder-quobyte-1b71603e-9a87-4766-8760-9409235acb84" released by "delete_volume" :: held 0.644s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Created reservations ['a4b20d1a-72e4-496e-a582-2ef595fe62f0', '3a62bddf-17f4-48b9-ac6c-631a4c47b415', '747eaa8b-1dd6-4a24-9cb6-338a9e796571', 'e23e5884-1cd8-466f-9c18-2dc29f777991'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:09 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:09 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:09 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.240s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:09 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Deleted volume successfully. Nov 03 18:43:09 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-86747679-831a-4285-a2fa-e5c6e3c62ad4 tempest-ProjectMemberTests-653481150 None] Lock "cinder-1b71603e-9a87-4766-8760-9409235acb84-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (5d2db530-f2ac-47bd-b8c0-984a5021cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96eecfd3-66ec-498d-9c8d-5ece0c7fbc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96eecfd3-66ec-498d-9c8d-5ece0c7fbc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875434402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96448e5-68a5-40b3-a7d4-22a3256d2a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df4d312-4e70-4e14-ae1b-d818f8328ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df4d312-4e70-4e14-ae1b-d818f8328ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:12 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5253422-5c91-41ee-83c3-ddc5b43918ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5253422-5c91-41ee-83c3-ddc5b43918ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96448e5-68a5-40b3-a7d4-22a3256d2a4f', 'volume_name': 'volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af91bbe0-c5b6-42d4-af11-13702a8319a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af91bbe0-c5b6-42d4-af11-13702a8319a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0099abb3-0512-4b1a-95bc-c9655c59b9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Volume c96448e5-68a5-40b3-a7d4-22a3256d2a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f', 'volume_size': 1} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875434402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c96448e5-68a5-40b3-a7d4-22a3256d2a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:13Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Creating volume c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:43:13 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:13 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f 1073741824 Nov 03 18:43:13 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:13 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f 1073741824" returned: 0 in 0.407s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:13 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f Nov 03 18:43:13 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:13 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" returned: 0 in 0.240s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0099abb3-0512-4b1a-95bc-c9655c59b9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ec8882-09a7-47d5-bb78-fefa4c707d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:13 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Volume volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f (c96448e5-68a5-40b3-a7d4-22a3256d2a4f): created successfully Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ec8882-09a7-47d5-bb78-fefa4c707d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:13 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (5d2db530-f2ac-47bd-b8c0-984a5021cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:13 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-0dadc2e9-ef3f-4178-a0b4-c694b9a5b9b7 tempest-ProjectReaderTests-2097511118 None] Created volume successfully. Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Creating offline snapshot 693138d2-e782-4039-911c-63ff23aba69e of volume c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d70e3-8266-4f9d-8d07-9e0631d8e053]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:14 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f Nov 03 18:43:14 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:14 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" returned: 0 in 0.355s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:14 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e 1G Nov 03 18:43:14 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:14 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e 1G" returned: 0 in 0.383s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:14 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e Nov 03 18:43:14 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:15 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:15 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e is being set with open permissions: ugo+rw Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:15 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e Nov 03 18:43:15 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:15 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:15 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info Nov 03 18:43:15 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:15 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:15 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info is being set with open permissions: ugo+rw Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:15 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info Nov 03 18:43:15 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:15 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.info" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:15 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:15 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-65dedf70-14a1-4e6f-a31c-304cdf8c5ce2 tempest-ProjectReaderTests-2097511118 None] Create snapshot completed successfully Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-693138d2-e782-4039-911c-63ff23aba69e-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-693138d2-e782-4039-911c-63ff23aba69e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-693138d2-e782-4039-911c-63ff23aba69e" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-693138d2-e782-4039-911c-63ff23aba69e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Deleting offline snapshot 693138d2-e782-4039-911c-63ff23aba69e of volume c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] snapshot_file for this snap is: volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d54ea4-265c-48cf-be78-b9e042d7601d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:16 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e Nov 03 18:43:16 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:16 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e" returned: 0 in 0.355s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[15687530-7072-402c-9d74-efb7de377326]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:16 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:16 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f Nov 03 18:43:16 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:17 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" returned: 0 in 0.346s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:17 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e Nov 03 18:43:17 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:17 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e" returned: 0 in 0.331s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:17 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e Nov 03 18:43:17 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:17 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f.693138d2-e782-4039-911c-63ff23aba69e" returned: 0 in 0.239s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-693138d2-e782-4039-911c-63ff23aba69e" released by "_delete_snapshot" :: held 1.364s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" released by "delete_snapshot" :: held 1.383s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Created reservations ['33813ded-acf0-47f0-9e07-0bc6ccd5adb5', 'fab6b8c1-794b-4467-a270-e069ca760da9', 'c6e3f559-02ae-4d60-9aef-e4128fc55b26', 'f68334b4-39cf-49ca-84c8-19477545d488'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:17 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Delete snapshot completed successfully. Nov 03 18:43:17 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9e636d5c-33cb-4565-b47f-2faf7f95728a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-693138d2-e782-4039-911c-63ff23aba69e-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-c96448e5-68a5-40b3-a7d4-22a3256d2a4f-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-c96448e5-68a5-40b3-a7d4-22a3256d2a4f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" acquired by "delete_volume" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3484138-e9c6-4648-bf08-1dd42c40aa69]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:18 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f Nov 03 18:43:18 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:18 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" returned: 0 in 0.354s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:18 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:18 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f Nov 03 18:43:18 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:19 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" returned: 0 in 0.242s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-c96448e5-68a5-40b3-a7d4-22a3256d2a4f" released by "delete_volume" :: held 0.651s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Created reservations ['73740972-2cac-48d2-a5ba-35fe81e34afc', 'c693f1ac-f13b-4eba-ba7b-4737b3b022a1', '3737cfcb-d757-4d34-90d2-12d1843a507c', 'cb986262-8210-4480-9a16-bf823767b0e1'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:19 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:19 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:19 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.242s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:19 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Deleted volume successfully. Nov 03 18:43:19 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-67045196-5d7e-4c4e-bb3a-2789b46c050a tempest-ProjectReaderTests-2097511118 None] Lock "cinder-c96448e5-68a5-40b3-a7d4-22a3256d2a4f-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (5da9037f-8dfb-49f6-a549-64daa6cdd467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e52177-0539-4b33-b497-cd9048adffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e52177-0539-4b33-b497-cd9048adffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53600707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ce60cb-ef68-405b-b199-429f4c20e659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:20Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b4a69b-d417-4455-a937-5caa836ee3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b4a69b-d417-4455-a937-5caa836ee3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904cd476-ecb7-4c9a-a954-2b6e178d8cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904cd476-ecb7-4c9a-a954-2b6e178d8cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ce60cb-ef68-405b-b199-429f4c20e659', 'volume_name': 'volume-58ce60cb-ef68-405b-b199-429f4c20e659', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0355d378-5034-46b6-b0f2-12ab63d8ce6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0355d378-5034-46b6-b0f2-12ab63d8ce6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675e3551-9ba8-4d30-aa86-fcfe7a6b1ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Volume 58ce60cb-ef68-405b-b199-429f4c20e659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ce60cb-ef68-405b-b199-429f4c20e659', 'volume_size': 1} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53600707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ce60cb-ef68-405b-b199-429f4c20e659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:20Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Creating volume 58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:43:20 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:20 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 1073741824 Nov 03 18:43:20 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:20 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 1073741824" returned: 0 in 0.399s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:20 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 Nov 03 18:43:20 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:20 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675e3551-9ba8-4d30-aa86-fcfe7a6b1ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ce60cb-ef68-405b-b199-429f4c20e659', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36883d0a-66ca-46ab-b213-ef4ebfccd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:20 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Volume volume-58ce60cb-ef68-405b-b199-429f4c20e659 (58ce60cb-ef68-405b-b199-429f4c20e659): created successfully Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36883d0a-66ca-46ab-b213-ef4ebfccd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:20 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (5da9037f-8dfb-49f6-a549-64daa6cdd467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:20 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-32e0afc9-acae-4a74-a857-3f9704c3e7c5 tempest-ProjectReaderTests-2097511118 None] Created volume successfully. Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Creating offline snapshot 5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac of volume 58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd679fb4-b068-4a8f-a281-82b6281f5faf]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:21 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 Nov 03 18:43:21 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:21 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659" returned: 0 in 0.356s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:21 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:21 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac 1G Nov 03 18:43:21 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:22 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac 1G" returned: 0 in 0.401s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce60cb-ef68-405b-b199-429f4c20e659 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:22 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce60cb-ef68-405b-b199-429f4c20e659 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac Nov 03 18:43:22 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:22 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce60cb-ef68-405b-b199-429f4c20e659 -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" returned: 0 in 0.296s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:22 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac is being set with open permissions: ugo+rw Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:22 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac Nov 03 18:43:22 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:22 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" returned: 0 in 0.249s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:22 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info Nov 03 18:43:22 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:22 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info" returned: 0 in 0.252s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:22 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info is being set with open permissions: ugo+rw Nov 03 18:43:22 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:22 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info Nov 03 18:43:22 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:23 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.info" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:23 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e3c3cf67-9cb3-46fe-b586-3d1142d515c4 tempest-ProjectReaderTests-2097511118 None] Create snapshot completed successfully Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-58ce60cb-ef68-405b-b199-429f4c20e659" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-58ce60cb-ef68-405b-b199-429f4c20e659" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Deleting offline snapshot 5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac of volume 58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] snapshot_file for this snap is: volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ce2ee9-9539-4930-9ca0-eb60f467433d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:23 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac Nov 03 18:43:23 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:23 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" returned: 0 in 0.411s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58ce60cb-ef68-405b-b199-429f4c20e659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ec2d16-a371-4ade-befd-67bce14b2bc9]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:23 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:24 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 Nov 03 18:43:24 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:24 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659" returned: 0 in 0.358s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:24 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac Nov 03 18:43:24 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:24 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" returned: 0 in 0.309s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:24 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac Nov 03 18:43:24 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:24 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659.5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac" released by "_delete_snapshot" :: held 1.421s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-58ce60cb-ef68-405b-b199-429f4c20e659" released by "delete_snapshot" :: held 1.443s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Created reservations ['ddc31a1f-aeb3-4c03-8fb7-42b3aa6fcbc2', '93297a10-87f9-4074-88f3-63fded18f4c6', 'cd16f2bf-ada0-408c-bfd1-9a5f43055eff', 'd3974ebd-e594-446b-82aa-cd0bf39ea72d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:24 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Delete snapshot completed successfully. Nov 03 18:43:24 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9620b458-7a03-4467-80b6-aa3859965c24 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-5ca0c8fd-b8c6-4c68-8c68-e958c81e46ac-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-58ce60cb-ef68-405b-b199-429f4c20e659-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Lock "cinder-58ce60cb-ef68-405b-b199-429f4c20e659-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-58ce60cb-ef68-405b-b199-429f4c20e659" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-58ce60cb-ef68-405b-b199-429f4c20e659" acquired by "delete_volume" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35da7c0-7a15-43d9-9dfb-4eba663101b2]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:25 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 Nov 03 18:43:25 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:25 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659" returned: 0 in 0.354s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:25 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:25 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659 Nov 03 18:43:25 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:26 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-58ce60cb-ef68-405b-b199-429f4c20e659" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-58ce60cb-ef68-405b-b199-429f4c20e659" released by "delete_volume" :: held 0.646s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Created reservations ['97b91bca-5a24-44c4-b198-7523f6c0c3c2', 'bc1023e3-2e60-4f2e-9843-8287e8abd305', '1539f5fb-d584-4228-b03c-caf58cd386bc', '1d0d6c38-c3ab-4ef4-82c3-dea3dfbd7f98'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:26 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:26 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:26 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.235s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:26 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Deleted volume successfully. Nov 03 18:43:26 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-4296e245-c1ce-4bbe-a0db-3e5a1a2e6c6c tempest-ProjectReaderTests-2097511118 None] Lock "cinder-58ce60cb-ef68-405b-b199-429f4c20e659-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (404ef0b9-d79c-4966-98a8-6a8083a45bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfea002-7786-4ee1-90f2-c659f8bd4842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcfea002-7786-4ee1-90f2-c659f8bd4842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982659186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1051a0b1-3aa5-4265-a310-678958b9627c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:27Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda3ee4a-d8ff-45bb-9c2a-17af74af92b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda3ee4a-d8ff-45bb-9c2a-17af74af92b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01407f2e-a012-4d6a-b926-b214dc5d1bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01407f2e-a012-4d6a-b926-b214dc5d1bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1051a0b1-3aa5-4265-a310-678958b9627c', 'volume_name': 'volume-1051a0b1-3aa5-4265-a310-678958b9627c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034f34f8-fcda-4204-86ec-7ebc6fa08877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034f34f8-fcda-4204-86ec-7ebc6fa08877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3b1fe2-c70b-4605-9971-0b3fe1ca0bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:27 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Volume 1051a0b1-3aa5-4265-a310-678958b9627c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1051a0b1-3aa5-4265-a310-678958b9627c', 'volume_size': 1} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982659186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1051a0b1-3aa5-4265-a310-678958b9627c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:27Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Creating volume 1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:43:27 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:27 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c 1073741824 Nov 03 18:43:27 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:27 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c 1073741824" returned: 0 in 0.400s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:27 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c Nov 03 18:43:27 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:27 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3b1fe2-c70b-4605-9971-0b3fe1ca0bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1051a0b1-3aa5-4265-a310-678958b9627c', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aca3a5b-3c42-4eeb-9a47-f39231c33185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:27 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Volume volume-1051a0b1-3aa5-4265-a310-678958b9627c (1051a0b1-3aa5-4265-a310-678958b9627c): created successfully Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aca3a5b-3c42-4eeb-9a47-f39231c33185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:27 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (404ef0b9-d79c-4966-98a8-6a8083a45bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:27 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-7a05f6aa-d53b-4354-8bf2-d4dcc4ee23d6 tempest-ProjectReaderTests-2097511118 None] Created volume successfully. Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Creating offline snapshot cd9ebc79-be81-41aa-a401-81aacd94b516 of volume 1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a71997a-ffc7-4c48-9868-306e10527546]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:28 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c Nov 03 18:43:28 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:28 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:28 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 1G Nov 03 18:43:28 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:28 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 1G" returned: 0 in 0.382s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:28 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1051a0b1-3aa5-4265-a310-678958b9627c -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:29 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1051a0b1-3aa5-4265-a310-678958b9627c -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 Nov 03 18:43:29 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:29 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1051a0b1-3aa5-4265-a310-678958b9627c -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:29 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 is being set with open permissions: ugo+rw Nov 03 18:43:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:29 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 Nov 03 18:43:29 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:29 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:29 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info Nov 03 18:43:29 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:29 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:29 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info is being set with open permissions: ugo+rw Nov 03 18:43:29 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:29 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info Nov 03 18:43:29 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:30 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.info" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:30 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-50da26b3-2664-4eb0-93b0-cb9164bdd2f6 tempest-ProjectReaderTests-2097511118 None] Create snapshot completed successfully Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-cd9ebc79-be81-41aa-a401-81aacd94b516-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-cd9ebc79-be81-41aa-a401-81aacd94b516-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-1051a0b1-3aa5-4265-a310-678958b9627c" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-1051a0b1-3aa5-4265-a310-678958b9627c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-cd9ebc79-be81-41aa-a401-81aacd94b516" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-cd9ebc79-be81-41aa-a401-81aacd94b516" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Deleting offline snapshot cd9ebc79-be81-41aa-a401-81aacd94b516 of volume 1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] snapshot_file for this snap is: volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd4114d-06da-4cf9-84d4-523b807f9d06]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:30 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 Nov 03 18:43:30 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:30 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516" returned: 0 in 0.346s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1051a0b1-3aa5-4265-a310-678958b9627c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[615617e2-159c-474b-8383-f1acb11d785f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:30 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:30 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c Nov 03 18:43:30 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:31 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:31 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 Nov 03 18:43:31 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:31 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516" returned: 0 in 0.334s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:31 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516 Nov 03 18:43:31 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:31 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c.cd9ebc79-be81-41aa-a401-81aacd94b516" returned: 0 in 0.238s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-cd9ebc79-be81-41aa-a401-81aacd94b516" released by "_delete_snapshot" :: held 1.360s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-1051a0b1-3aa5-4265-a310-678958b9627c" released by "delete_snapshot" :: held 1.382s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Created reservations ['57a7407b-02cd-455a-83d6-7d01c78f9269', '99c4ed53-434d-4fd3-8040-178280986823', '91230194-552f-4947-941e-e53e846e6267', '3f9347f2-dfd0-41be-ac83-be5e371303c0'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:31 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Delete snapshot completed successfully. Nov 03 18:43:31 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-50caa66e-470e-472e-b1cb-8871bb6ff2d0 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-cd9ebc79-be81-41aa-a401-81aacd94b516-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-1051a0b1-3aa5-4265-a310-678958b9627c-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Lock "cinder-1051a0b1-3aa5-4265-a310-678958b9627c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-1051a0b1-3aa5-4265-a310-678958b9627c" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-1051a0b1-3aa5-4265-a310-678958b9627c" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d84e58-067c-47e4-bb74-f039bd816ac7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:32 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c Nov 03 18:43:32 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:32 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c" returned: 0 in 0.351s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:32 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:32 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c Nov 03 18:43:32 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:33 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-1051a0b1-3aa5-4265-a310-678958b9627c" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-1051a0b1-3aa5-4265-a310-678958b9627c" released by "delete_volume" :: held 0.650s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Created reservations ['f26ae35c-ea10-4172-a718-9bc575d3ef6d', 'ce935f5a-db7b-4750-9b0c-3236b4539356', '65ffe72d-9f11-4def-bf2b-d0ffe719da80', '8ad94f4c-d96a-4ff0-acd4-632fe87ba64d'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:33 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:33 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:33 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.230s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:33 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Deleted volume successfully. Nov 03 18:43:33 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-9811c487-9546-4834-97ab-4c7de0f502ac tempest-ProjectReaderTests-2097511118 None] Lock "cinder-1051a0b1-3aa5-4265-a310-678958b9627c-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (81285d89-7bf2-486a-a253-7401173424cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e2ed4a-a2bf-48b1-846f-b50748f9583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e2ed4a-a2bf-48b1-846f-b50748f9583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730540225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:34Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d544c53d-5123-43b4-8311-a9d3556d28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d544c53d-5123-43b4-8311-a9d3556d28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82848ad3-4969-44ee-b55b-ef9eb27c0916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82848ad3-4969-44ee-b55b-ef9eb27c0916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e', 'volume_name': 'volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f842e8c-1aef-4312-a07e-19e7bf7ba810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f842e8c-1aef-4312-a07e-19e7bf7ba810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05564c10-4fd2-4094-a3d2-841b4e3725a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Volume 2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e', 'volume_size': 1} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730540225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:34Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Creating volume 2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:43:34 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:34 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e 1073741824 Nov 03 18:43:34 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:34 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e 1073741824" returned: 0 in 0.391s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:34 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e Nov 03 18:43:34 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:34 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" returned: 0 in 0.233s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05564c10-4fd2-4094-a3d2-841b4e3725a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f507a0-4f26-482f-89db-a3439182a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:34 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Volume volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e (2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e): created successfully Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f507a0-4f26-482f-89db-a3439182a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:34 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (81285d89-7bf2-486a-a253-7401173424cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:34 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-5aa0f930-dcab-4e09-b28d-ab97fa3cc94a tempest-ProjectReaderTests-2097511118 None] Created volume successfully. Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Creating offline snapshot 052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 of volume 2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38ba0c-80d1-44eb-8fe7-83229eebe87c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:35 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e Nov 03 18:43:35 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:35 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" returned: 0 in 0.345s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:35 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 1G Nov 03 18:43:35 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:35 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 1G" returned: 0 in 0.383s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:35 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:35 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 Nov 03 18:43:35 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:36 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" returned: 0 in 0.281s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:36 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 is being set with open permissions: ugo+rw Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:36 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 Nov 03 18:43:36 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:36 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" returned: 0 in 0.229s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:36 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info Nov 03 18:43:36 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:36 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info" returned: 0 in 0.250s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:36 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info is being set with open permissions: ugo+rw Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:36 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info Nov 03 18:43:36 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:36 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.info" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:36 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:37 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-e8c78b9d-533e-4531-b0e0-45c221a0a0d1 tempest-ProjectReaderTests-2097511118 None] Create snapshot completed successfully Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Deleting offline snapshot 052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 of volume 2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] snapshot_file for this snap is: volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc113260-badc-4b97-b557-0bfa23b49704]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:37 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 Nov 03 18:43:37 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:37 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" returned: 0 in 0.379s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed5de1-e000-40b1-8b62-b27f8189401d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:37 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:37 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e Nov 03 18:43:37 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:38 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" returned: 0 in 0.371s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:38 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 Nov 03 18:43:38 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:38 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" returned: 0 in 0.332s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:38 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3 Nov 03 18:43:38 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:38 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e.052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" returned: 0 in 0.243s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3" released by "_delete_snapshot" :: held 1.417s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" released by "delete_snapshot" :: held 1.439s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Created reservations ['aa2e56c5-88e6-4ba9-8911-875dc771f957', '55c818bf-7882-4b04-b383-a34f527183c7', '2ef5390d-3a98-4339-90aa-4fa121a03444', '7d41df68-4449-4215-919a-bca4e6740758'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:38 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Delete snapshot completed successfully. Nov 03 18:43:38 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-3be52297-ed65-4452-a097-9713e3637943 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-052a4efb-7fbd-4c88-9cfc-f4d7f5d6b2f3-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" acquired by "delete_volume" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c7add-1f67-4d16-b7fe-8ad619f9aa7c]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:39 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e Nov 03 18:43:39 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:39 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" returned: 0 in 0.350s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:39 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:39 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e Nov 03 18:43:39 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:40 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e" released by "delete_volume" :: held 0.643s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Created reservations ['cf50fb29-4334-498a-99c7-1ffeb360c2af', 'ca9a933e-0139-4569-a7c9-13ab4978722a', 'a802992f-ca51-4c2d-9e19-68a88a4eba5e', 'ea2889cb-7cfe-487d-94da-e564a15c2677'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:40 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:40 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:40 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:40 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Deleted volume successfully. Nov 03 18:43:40 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-c8f17b7f-7375-405f-893d-1dc73da87cc9 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-2cbf74c8-bc68-4a87-a4db-2fa1fc8aaf7e-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.flows.manager.create_volume [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86841) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (2e914bec-414f-40c0-bba6-47ddc51ae81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf44134-ee03-40fa-ba89-f40ff6e3aeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf44134-ee03-40fa-ba89-f40ff6e3aeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1636152797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39f303-6ff9-464b-8d1e-0fbbff7f052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:41Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521b4b21-c477-4a57-a476-df634e6635b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521b4b21-c477-4a57-a476-df634e6635b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a12bb84-2a98-4ddf-894e-29d830cb836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a12bb84-2a98-4ddf-894e-29d830cb836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb39f303-6ff9-464b-8d1e-0fbbff7f052b', 'volume_name': 'volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef4caa7-9a63-492d-b60f-25df6d9bc34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef4caa7-9a63-492d-b60f-25df6d9bc34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413b8a10-992a-40ba-a7bc-ed3641ae737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Volume eb39f303-6ff9-464b-8d1e-0fbbff7f052b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b', 'volume_size': 1} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-03T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1636152797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39f303-6ff9-464b-8d1e-0fbbff7f052b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1f1bef6601409bb72a89fb32053fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-03T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-03T17:43:41Z,use_quota=True,user_id='da48f8c260344f41ac8d392ad8e54b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70626e1e-30a6-461d-87a9-c50aa2f14335),volume_type_id=70626e1e-30a6-461d-87a9-c50aa2f14335)}" {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Creating volume eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Selected osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 as target Quobyte volume. {{(pid=86841) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 03 18:43:41 devstack cinder-volume[86841]: INFO cinder.volume.drivers.remotefs [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] casted to osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45 Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b 1073741824 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:41 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b 1073741824 Nov 03 18:43:41 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:41 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b 1073741824" returned: 0 in 0.390s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:41 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b Nov 03 18:43:41 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:41 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" returned: 0 in 0.233s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'} {{(pid=86841) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413b8a10-992a-40ba-a7bc-ed3641ae737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b', 'volume_size': 1}' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5283cfc6-2398-4ebe-8e75-61a27e201ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 03 18:43:41 devstack cinder-volume[86841]: INFO cinder.volume.flows.manager.create_volume [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Volume volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b (eb39f303-6ff9-464b-8d1e-0fbbff7f052b): created successfully Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5283cfc6-2398-4ebe-8e75-61a27e201ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86841) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 03 18:43:41 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Flow 'volume_create_manager' (2e914bec-414f-40c0-bba6-47ddc51ae81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86841) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 03 18:43:41 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-8821b3fd-37a6-4920-9eef-e1b23531d599 tempest-ProjectReaderTests-2097511118 None] Created volume successfully. Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Creating offline snapshot 57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 of volume eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc39e2b3-b6a1-4033-9f7c-a0c15a31fa9f]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:42 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b Nov 03 18:43:42 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:42 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" returned: 0 in 0.345s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 1G {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:42 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 1G Nov 03 18:43:42 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:42 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 1G" returned: 0 in 0.377s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:42 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:42 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 Nov 03 18:43:42 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:43 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b -F qcow2 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" returned: 0 in 0.284s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:43 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 is being set with open permissions: ugo+rw Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:43 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 Nov 03 18:43:43 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:43 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" returned: 0 in 0.235s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:43 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info Nov 03 18:43:43 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:43 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:43 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.remotefs [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info is being set with open permissions: ugo+rw Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:43 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info Nov 03 18:43:43 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:43 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.info" returned: 0 in 0.240s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:43 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:44 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-2d7e0ac3-d136-481a-b5c0-3977aba97213 tempest-ProjectReaderTests-2097511118 None] Create snapshot completed successfully Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8-delete_snapshot" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" by "delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" by "_delete_snapshot" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Deleting offline snapshot 57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 of volume eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] snapshot_file for this snap is: volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 {{(pid=86841) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c468fd-7758-4817-923a-e9b6603593a7]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:44 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 Nov 03 18:43:44 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:44 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" returned: 0 in 0.347s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86841) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac7d5d-dd1c-4423-8ff1-dd61899cc91b]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:44 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:44 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b Nov 03 18:43:44 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:45 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" returned: 0 in 0.344s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:45 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 Nov 03 18:43:45 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:45 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" returned: 0 in 0.318s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:45 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8 Nov 03 18:43:45 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:45 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b.57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" returned: 0 in 0.236s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8" released by "_delete_snapshot" :: held 1.335s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" released by "delete_snapshot" :: held 1.356s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=108,cinder:INSERT=38,cinder:UPDATE=143,cinder:DELETE=10 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=121,cinder:INSERT=43,cinder:UPDATE=147,cinder:DELETE=15 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Created reservations ['3691f32e-8003-466e-b069-e6e3b35c02b1', 'e4f12a78-4a62-4439-a38a-fb4add1a93c9', '9fe8a184-be79-47d2-b438-ef8f22204a51', '7f1bf4e4-b135-4e1e-8edd-a8b353a9c133'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:45 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Delete snapshot completed successfully. Nov 03 18:43:45 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-44bd97d4-739a-4265-877a-9f6bc236d844 tempest-ProjectReaderTests-2097511118 None] Lock "cinder-57270f5f-1dfc-4ca4-abcd-d9c8a1b2aaf8-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-eb39f303-6ff9-464b-8d1e-0fbbff7f052b-delete_volume" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Lock "cinder-eb39f303-6ff9-464b-8d1e-0fbbff7f052b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Acquiring lock "cinder-quobyte-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" by "delete_volume" {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" acquired by "delete_volume" :: waited 0.014s {{(pid=86841) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdb1683-1d79-4094-81b6-b75fb290744d]: (4, 'qcow2') {{(pid=88026) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:46 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b Nov 03 18:43:46 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:46 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" returned: 0 in 0.344s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:46 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:46 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b Nov 03 18:43:46 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:47 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b/volume-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" returned: 0 in 0.237s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Lock "cinder-quobyte-eb39f303-6ff9-464b-8d1e-0fbbff7f052b" released by "delete_volume" :: held 0.638s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG cinder.quota [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Created reservations ['796a1ac1-b741-46c2-9d6e-fc6259b59e6d', '6086d58e-a674-4497-afbe-331a4e18359d', 'e170b056-4070-4c91-81a2-e7024b2fc30a', 'aa85a4d0-aca1-40f1-a8a2-834d70ee153c'] {{(pid=86841) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:47 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:47 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:47 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.234s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:47 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Deleted volume successfully. Nov 03 18:43:47 devstack cinder-volume[86841]: DEBUG cinder.coordination [None req-5b181088-c68f-463a-9542-accbd36b018d tempest-ProjectReaderTests-2097511118 None] Lock "cinder-eb39f303-6ff9-464b-8d1e-0fbbff7f052b-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86841) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 03 18:43:57 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=8,cinder:INSERT=5,cinder:UPDATE=15 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:43:57 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-816fe714-1622-4694-bff2-c2d34e7deb45'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 03 18:43:59 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b Nov 03 18:43:59 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 03 18:43:59 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/894841779fcd710e473146d2fbe7844b" returned: 0 in 0.234s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG oslo_service.periodic_task [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] Running periodic task VolumeManager._thread_info {{(pid=86841) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread count: 28 {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 03 18:43:59 devstack cinder-volume[86841]: DEBUG cinder.volume.manager [None req-bde47d67-6674-4509-8b0b-cce0ced5e728 None None] thread info: [<_MainThread(MainThread, started 123562945663104)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86841) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}